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ABSTRACT 



The Professional Development Program (PDP) of Rockefeller 
College of the State University of New York, in partnership with the 
Eddy/Northeast Health of Troy, New York, conducted a 3 -year demonstration 
project to provide and foster institutionalization of a functionally 
contextual workplace literacy curriculum and training program to upgrade the 
basic skills of paraprofessional health care workers in geriatric 
institutions. Data collected during extensive onsite investigations and job 
analyses were used to develop a three-stage workplace literacy intervention 
consisting of the following: learning strategies workshop; 17-hour program 
devoted to easing into the job of certified nursing assistant; and 20-hour 
program devoted to new directions in customer service. In all, 1,452 trainees 
and employees of Eddy/Northeast Health participated in the program. An 
external evaluator, Performance Plus Learning Consultants, Inc. (PPLC) , was 
hired to evaluate the demonstration program’s effectiveness. The 
PDP-Eddy/Northeast Health workplace literacy program model for eldercare 
workers was determined to be effective for the project's specific context, 
and its instructional design and materials were deemed transportable across 
the industry. (Appendixes constituting approximately two- thirds of the 
document contain pre- and postassessment data; PPLC and PDP/Eddy data 
collection instruments; and U.S. Department of Education data collection 
instruments.) (MN) 
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Introduction 



Background - 

The Professional Development Program of Rockefeller College, University at 
Albany, State University of New York (PDP), in partnership with The Eddy/Northeast 
Health of Troy, New York, was funded initially by a 36-month grant award from the U.S. 
Department of Education National Workplace Literacy Program to provide and foster 
institutionalization of a functionally contextual workplace literacy curriculum and 
training program to up-grade the basic skills of health care workers in geriatric 
institutions. The program operated as a national workplace literacy demonstration project 
from January, 1995 through April 30, 1998 including a four-month no-cost extension. 
The purpose of the demonstration was to determine the effectiveness of the partners’ 
proposed workplace applications of basic skills training model. 

The need for this project grew from a recognition by The Eddy and the PDP at 
Rockefeller College of the changing needs in the health care workforce, especially in the 
area of certified nursing assistants and home health care aides. The Eddy/Northeast 
Health operates geriatric facilities and home heath care services across upper New York 
State. According to published materials available at the onset of the demonstration 
project, the Eddy was comprised of 14 affiliated organizations, employing approximately 
1300 employees and serving over 12,700 persons each year. The Eddy consisted of 
rehabilitation facilities, senior day care facilities, assisted living residences, nursing 
homes, and visiting health care aide services. Following a merger with Northeast Health 
in 1996, the organization added hospitals and additional patient services. 

The paraprofessional employees at each of these facilities and organizations who 
are responsible for direct care of residents and patients, are required to demonstrate 
mastery of high-level literacy skills in their on-the-job performance— very often at an 
expert level— immediately upon completion of new-hire training programs. As noted in 
the proposal for funding (March, 1994): 

In developing a patient’s or resident’s Care Plan, Care Planning 
Meetings are held. The plans are designed to be carried out by a team 
of workers, of which the Certified Nursing Aide or the Home Health 
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Care Aide is the critical member, depending on whether the client is in 
a home or institutional setting. . ..The ability to read and understand the 
Care Plan, and all related documents and information, is an important 
part of both the Certified Nurses Aide and Home Health Aide jobs. 
These employees need to be able to make daily, even hourly, decisions 
that operate to accomplish the plan, and to solve both simple and 
complex problems that confront them as barriers to accomplishment of 
plan elements. In performing their primary job duties of providing for 
the daily personal care needed by the elderly resident or patient — 
walking, bathing, dressing, meal preparation, food shopping, light 
housekeeping, etc. — the Nurse Aide and Home Health Aide interact 
closely with the patients and residents. The need for strong 
interpersonal skills and exceptional skill in listening and speaking, is 
vital to successful job performance. The Aide must be able to develop 
a relationship with the elderly patient or resident, understand his or her 
problems and needs, provide needed direction and assistance, and work 
closely with nursing and management staff to ensure that the provisions 
of the Care Flan are carried out consistently and adequately In addition 
the role of observation is significant; it is the Nurse Aide and Home 
Health Aide who observe the patients and residents on a daily basis, 
and who are most able to observe normal behavior and the variations 
from that behavior, which may be early signs of dementia, 
Alzheimer’s, and other diseases of the elderly that forecast a need for 
change in Care Plans and daily job tasks. And, ultimately, the need for 
Aides to document and provide appropriate oral reporting on both task 
accomplishment, and on daily routine and behavior of the patient or 
resident, is a necessary literacy requirement of the workplace, not only 
to ensure quality and consistency of care but also to respond to the 
highly regulatory nature of the workplace.... 

In addition, Aides must be able to leam in a classroom environment as 
well as on the job, and must translate what has been learned into 
appropriate workplace behavior. A requirement for employment is 
successful completion of an initial training period. It is projected by 
The Eddy’s training staff that the high attrition rate of new employees 
may be a result, in part, of the literacy requirements of the training 
programs.... 

The implementation of Continuous Quality Improvement, The Eddy’s 
effort to implement total quality management, is creating a changing 
workplace environment that is increasing the skill requirements of both 
the Nurse Aides and Home Health Aides... .The requirement for these 
staff members to be participatory players in problem solving and 
decision making, at a much higher level than was expected of them 
before CQI, has implications for their literacy levels. . . . 

....the literacy requirements of the jobs that the Certified Nurse Aides 
and the Home Health Aides perform... are as follows: 

Reading : Both CNAs and Home Health Aides are required to read 
regulations, directives, doctors’ orders, care plans, nutritional 
information, newsletters, and all other documents and texts that provide 
information about the care of the elderly, as well as the specific Care 
Plan of each patient or resident. They must understand and be 
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accountable for information communicated in written form, regarding 
the Care Plan. 

Writing : Both CNAs and Home Health Aides must be able to 
communicate clearly in writing and document their observations in 
written form. The highly regulatory nature of the workplace requires 
the recording and documenting of both patient and resident behavior 
and accomplishment of elements of the Care Plan. The log entry is the 
primary means of documenting task accomplishment. 

Oral Communication and Interpersonal Skills : Both CNAs and Home 
Health Aides must communicate and interact with the elderly patients 
and residents in their care, with supervisors, [with family members], 
and with other members of the Care Plan team. These skills are 
especially important for the Home Health Aide, who relies primarily on 
oral communication to fill the gaps that are created as a result of the 
isolation of the home care environment, as opposed to the institutional 
environment in which CNAs operate. It is through effective listening 
and speaking that the Aide develops and maintains the relationship with 
the elderly patient or resident, which is the foundation of successful job 
accomplishment. Listening and speaking with the hearing impaired, 
and those with other perceptual or cognitive impairments, is a set of 
special oral communication and interpersonal skills that needs to be 
addressed. 

Observation : CNAs and Home Health Aides must recognize signs of 
dementia, phobia, and other illnesses of the elderly. The Aides are the 
daily source of information regarding the patient or resident, and 
observation of behavior is their primary source. 

Problem Solving and Decision Makinz : In their day-to-day job 
accomplishment. Aides are called upon to solve problems of daily 
living and to make decisions regarding the personal care of patients and 
residents. They are called upon to make decisions about medical 
equipment use, to assess what patients can and cannot do, and to make 
appropriate decisions about daily activity limits. They must identify 
unusual events and behaviors, and know when and when not to call for 
help. They must be good managers of crisis situations, often 
confronting the diminishing capabilities of the patients and residents 
with sensitivity, but also with firm decision making. Often in the case 
of CNAs, and almost always in the case of Home Health Aides, these 
processes are accomplished independently with no supervisory 
intervention. 

Math : Among their math-related tasks, the Aides are asked to assist 
patients or residents in money management and balancing of check 
books; they identify medicine amounts; they must be effective time 
managers; and they may need to weigh and measure foods. 

Independent Leaminr . Both the CNAs and the Home Health Aides go 
through an initial job skills training. The success or lack of success that 
the Aide experiences in training is critical to the institution’s decision 
in determining whether or not to employ the individual upon 
completion of training. The training is text dependent and requires a 
high level of personal motivation. Once the initial training is 
accomplished, periodic in-service training is provided to the Aides, 
often through independent learning modalities, such as videotape. 
Application of learning to job performance is also an expectation. 

— [ Proposal , pp. 6-10] 
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As noted above, the accuracy, objectivity, and completeness of care and record 
keeping in compliance with agency regulations is critical because it directly affects the 
lives of patients, residents and their families, and may be subject to scrutiny as part of 
legal proceedings. Additionally, stress factors incurred by new hires often lead to high 
rates of turn-over. Consequently, workplace literacy is perceived as an important 
addition to the Eddy’s new-hire certification and training programs, as well as an 
enhancement to training for experienced employees, because all employees, new and 
experienced alike, must be ready to document and communicate observations of resident 
behavior, solve problems and work together as valued members of health care teams. 

In order to become a Certified Nursing Assistant (CNA) or Home Health Care 
Aide (HHA), a candidate must attend training and become certified. Existing new-hire 
training courses offered by the Eddy required 10 days training for HHAs and 100 hours 
of training for CNAs. The training contained the following areas of study: introduction 
to the role of Certified Nursing Assistants or Home Health Care Aides in the health care 
system; patient care; and medical terminology. Because such technical training-specific 
courses and traditional education often do not give workers a broad-based knowledge of 
team communication, problem solving, critical thinking, and leaming-how-to-learn 
concepts and competencies, The Eddy and the PDP determined the need for training 
sessions that would provide The Eddy new hires and incumbent workforce with 
workplace learning strategies, communication and problem-solving skills that are 
transferable and adaptable to their sensitive work environment. 

Prior to applying for this U.S. Department of Education National Workplace 
Literacy Demonstration Project grant, The Eddy had begun discussions with the PDP of 
Rockefeller College to foster the sharing of information and to clearly define health care 
employee needs (see above) and agency responses. These careful explorations to define 
needs and possibilities resulted in the partnering of The Eddy and the PDP to apply for 
federal grant monies for provision of on-site customized workplace basic skills training 
programs to accompany Eddy training. Administrators representing The Eddy’s Human 
Resource Department and training activities met with PDP staff to ensure that the 
customized programs would directly relate to the competencies needed for their training 
courses and responded to the needs of the targeted new-hire and incumbent worker 
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participants. To this end, the education/health organization partnership members were 
committed to gathering additional data for performing a “front-end analysis” in order to 
assess the applied basic skills needs of targeted Certified Nursing Assistant and Home 
Health Aide trainees and employee-participants. They also determined program goals, 
scope of Eddy health care related content areas, length of sessions, schedules, 
recruitment, piloting, and implementation plans. This cooperative relationship continued 
throughout the funding cycle. 

The developers of the Essential Skills for the Care Team program, the PDP 
faculty members and project special hires that comprised a professional staff of 
curriculum consultants and professors with numerous advanced degrees and many years 
of experience in writing and teaching, then custom-designed, created, and delivered 
program pilots for Learning Strategies and Tier I courses ( Easing into the Job), along 
with co-authoring Tier II courses (New Directions in Customer Service) with 
Eddy/Northeast Health trainers. Complete participant assessment procedures and strong, 
functionally contextual workplace applied basic skills training programs were 
subsequently implemented and refined during the grant period. The Research Foundation 
of State University of New York, as grant fiscal manager, contracted with Performance 
Plus Learning Consultants, Inc. (PPLC) to serve as a third-party evaluator throughout the 
project. 



Purpose of the Evaluation : The Research Foundation of State University of New York, 
on behalf of the PDP of Rockefeller College has requested this third-party evaluation of 
their U.S. Department of Education National Workplace Literacy Demonstration Project 
to assess: 1.), the extent to which the project’s goals and objectives have been 
accomplished; and, 2.), the extent to which program development, implementation, 
expansion, and institutionalization proceeded as planned. Specifically, the evaluation 
objectives to be investigated, based on the project goals and objectives published in the 
proposal for funding ( Proposal , pp. 35-37), were: 

• on-going identification of the program’s strengths and areas still needing any 
improvement throughout the life of the project; 
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• evidence indicating development and demonstration of a workplace literacy 
program model for eldercare workers that is both effective for the specific 
context of the project, and transportable across the industry, including 
instructional design and materials by: 

-conducting a thorough workplace literacy task analysis of all targeted job 
categories across The Eddy and its network of affiliates; 

-producing a 40-hour, two-tier curriculum in workplace literacy skills for 
Certified Nurse Aides, Home Health Care Aides, and ancillary staff of the 
Care Plan Team, the housekeeping and custodial workers, and the food 
service staff, that addresses the results of the task analyses and that will be 
partially video-based; 

-tailoring the existing 4-hour Learning Strategies module to the Nurse 
Aide and Home Health Aide new hire population to prepare them for their 
initial job training; 

-developing a 4-hour orientation and instruction program for supervisors 
of the targeted workers; 

-developing — through the supervisory staff of the targeted categories of 
workers, through The Eddy’s human resource counseling function, 
through Literacy Volunteers of America of New York State local 
affiliates, through the establishment of learning resource centers within the 
physical plant of and its network affiliates, and through a peer “buddy” 
system — the capacity to provide ongoing support to the targeted workers 
after their initial training; 

-developing and periodically administering workplace literacy assessment 
and evaluation measures that will yield quantitative data to examine the 
effects of instruction; 
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-producing, through an outside evaluator, an analysis of the overall 
effectiveness of the proposed program with respect to the immediate target 
population and the industry within which it is implemented; and, 

-making the curriculum design and materials available to the adult literacy 
field and the eldercare industry through conference presentations, 
professional gatherings, and various publications. 



• evidence of literacy gains among members of the Care Plan Team of The 
Eddy and its network of affiliates — the Certified Nursing Assistants, the 
Home Health Care Aides, and the ancillary Housekeeping, Custodial, and 
Food Service staffs — in order to enable the Assistants/ Aides to complete their 
initial job training, and to enable all staff to perform literacy-related job tasks 
more effectively to increase job productivity by: 



-delivering the 20-hour, Tier 1 curriculum over the three-year period of 



funding to all new hires in the targeted job categories across the network 
of affiliates (approximately 750 employees); 



-delivering the 20-hour, Tier 2 curriculum over the third year of funding to 
all veteran staff, including those who received the Tier 1 instruction in the 
first and second years of funding (approximately 840 employees); 

- delivering the revised, customized Learning Strategies module to all the 
new hires during the course of the three-year period of funding through a 
video-based module; 



-developing and administering a workplace literacy skills assessment that 
will inform instruction and be used as the basis for Individual Education 
Plans; and, 
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-designing a process for the development and implementation of the 
Individualized Education Plan for each new hire, that will incorporate a 
role for The Eddy’s human resource and training functions. 



Description of the Project to be Evaluated : The Essential Skills for the Care Team 
program consisted of a workplace literacy training partnership formed between the PDP 
of Rockefeller College and The Eddy/Northeast Health organization. According to the 
published description of the program, the design of the project was structured to meet 
CNAs’, HHAs’, and other paraprofessional health care staff members’ job-specific basic 
skills application needs in the health care system, through the development of 
functionally contextual curriculum and training. Extensive on-site investigations and job 
analysis conducted by project staff resulted in the gathering of Eddy health care team 
training and job materials and scenarios, as well as observation and in-depth analysis of 
applied basic skills used in task performance. This information was then used for 
development of a customized functionally contextual training program and instructional 
model tailored to meet the various Eddy affiliates’ needs in health care services provided 
across upper New York State. A brief description of the program follows: 

The program consisted of three stages of workplace literacy intervention. The initial 
effort was to revise an existing leaming-how-to-learn study skills course ( Learning 
Strategies ) that had been developed by the PDP under a previous, highly successful US 
Department of Education National Workplace Literacy Demonstration Project grant 
(1993-1995). Based on literacy job task analyses conducted at the onset of this grant, the 
existing course was reworked and customized to assist CNAs and HHAs as they began 
their initial training. The course was piloted twice, then delivered throughout the grant 
funding period as three consecutive two-hour sessions, including videotaped segments 
and individual workbooks. Learning Strategies was scheduled for delivery at the 
beginning of each of the initial Eddy CNA and HHA trainings and housed in the same 
locations. A total of 70 offerings of Learning Strategies were presented by PDP staff, 
with an average attendance of seven participants. 
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Tier I, Easing into the Job , was developed at the end of the first year of grant 
funding to support CNAs and HHAs during their first few months on the job. It consisted 
of five two-hour modules which were delivered during the last two and one half years of 
funding at three Eddy facilities: The Eddy Cohoes Rehabilitation Center, The Eddy 
Memorial Geriatric Center, and the Heritage House Nursing Center. The Tier I modules 
were delivered approximately 15 times each (records indicating a range of 13-20 times) 
by the PDP staff. Additionally, Tier I modules were customized for delivery to and self- 
study by Home Health Care Aides. As an alternate medium for delivery, courses also 
were adapted for electronic delivery on Web TV early in 1998, posted on the PDP web 
site, and successfully piloted. 

Tier II, New Directions in Customer Service, was developed during the second 
year of funding and focused on basic skills and thinking strategies that facilitate 
implementation of the mission statement and customer service policy adopted by the 
organization after their merger. Tier II courses were developed by the PDP in 
conjunction with the Northeast Health/Eddy training staff to encourage system-wide 
program support and institutionalization as a part of the organizational merger process. 
Tier II, was introduced by a two-hour orientation/overview, The Seven Points of 
Customer Service, that was jointly presented by the PDP and Eddy/Northeast Health staff 
to managers and supervisors throughout the system. The six Tier II courses were then 
delivered as requested in individual facilities as one- to three-hour sessions that included 
videotape segments. Individual New Directions in Customer Service modules delivery 
frequency varied from one time to thirteen times. Data through April 30, 1997, indicate 
that 1452 Eddy/Northeast Health trainees and employees ( 242 CNAs, 446 HHAs, and 
764 incumbent employees) participated in the three levels of the program for a total of 
4926 contact hours. 

Essential Skills for the Care Team focuses on improving oral and written job- 
related communication, problem solving, decision making, time management, 
interpersonal skills, and learning how to learn skills as identified in front-end project 
investigations. It is designed to provide instruction on three levels, broken into modules, 
that may be delivered in clusters or as individual topics. PLEASE NOTE: Numerous 
versions of the modules were produced in a variety of formats and with varying titles 
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during the project. The content of those versions of the modules provided to the external 
evaluator for review is as follows: 



• Learning Strategies : (3 hours) Facilitator’s Guide (43 pp.), videotape 
(80 minutes), and Activity Pak learner workbook (18 pp.). 

Topics : 

• Getting the Most Out of Your Training 

• Taking Notes 

• Skimming 

• Highlighting 

• Using Questions to Learn 

• Becoming Test Wise 

• Continuing to Be a Smart Learner 



Workplace Skills and Knowledge : 
-Study skills 
-Reading skills 
-Communication skills 
-Writing skills 
-Test-taking skills 
-Self-directed learning skills 
-Employment readiness 



Objectives : Upon completion of course, learners should be able to: 
-Take notes in a classroom lecture; 

-S ki m training handouts; 

-Highlight training handouts; 

-Ask questions to get needed information; 

-Take written and skills tests. 



Methods : individual and small group 

presentations with guided discussions, video 
self-assessment testing. 



activities, trainer 
presentations, and 




Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 

May, 1998 



13 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



13 



• Tier I: Easing into the Job - Certified Nursing Assistants (17 hours 
total), Facilitator’s Guide, including participant materials for 
duplication (230 pp.) 

Topics : 

• Understanding Your Assignment Sheet (2 hours) 

Workplace Skills and Knowledge : 

-Developing self-directed learning 
-Reading workplace materials 
-Writing for the workplace 
-Thinking analytically 

Objectives : Upon completion of this module, learners 

should be able to: 

-Recognize and understand the meaning of 
abbreviations commonly used at long-term-care 
worksites; 

-Identify at least two resources available at their 
worksite for determining the meaning of unfamiliar 
abbreviations; 

-State and explain the use of specific strategies to learn 
unfamiliar abbreviations; 

-Write and state the meaning of all abbreviations on an 
assignment sheet from their worksite; 

-‘Translate” abbreviated directions into complete 
statements about resident care at their worksite. 

Methods : individual and small group activities, trainer 

presentations with guided discussions. 

• Managing Your Assignment (3 hours) 
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Workplace Skills and Knowledge : 

-Developing self-management 
-Reading workplace materials 
-Thinking analytically 
-Ordering and prioritizing 
-Making decisions 
-Managing time 
-Working in teams 

Objectives : Upon completing this module, learners should 
be able to: 

-Analyze personal care tasks in terms of the conditions 
that affect how they are carried out; 

-List the personal care job tasks for one resident in an 
appropriate order of accomplishment; 

-Plan the care for many residents according to an 
appropriate order, considering the conditions and 
external factors; 

-Identify the need for and the value of prioritizing the 
assignment. 

Methods : individual and small group activities, trainer 

presentations with guided discussions. 

• Knowing and Understanding Your Residents (3 hours) 

Workplace Skills and Knowledge : 

-Develop self-directed learning 

-Build new vocabulary words and their meanings 

-Build new medical terminology and their meanings 

-Use the dictionary as a resource 

-Formulate plans to anticipate resident and unit needs 
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-Perceive the importance of treating the health care 
team and residents with respect 

-Value the dignity of individual residents and others 
regardless of cultural, gender, and ethnic diversity 
-Recognize and be empathetic to the unique needs and 
problems of the elderly in a residential setting 
-Determine the relative significance of new information 
that may serve as a catalyst for change in a process, 
procedure, or general resident care 
-Be able to differentiate between “subjective” and 
“objective” observations 

-Determine appropriate nursing assistant actions for the 
care of the elderly. 

Objectives : Upon completion of this module, learners 

should be able to: 

-Recognize the difference between “caring” and being a 
“care-giver;” 

-Enhance sensitivity to the unique needs and situations 
of the elderly in a residential environment; 

-Describe Maslow’s Theory and be able to relate it to 
needs of the elderly; 

-List Maslow’s five needs; 

-Identify two ways the care-taking role can assist the 
elderly in meeting their needs; 

-Distinguish between “objective” and “subjective” 
observations; 

-Demonstrate through group exercise increased 
knowledge and skills in resident observations that 
contribute positively or negatively to the safety, 
security, and quality of patient care; 

-Differentiate between “old” and “new” resident 
observation information; 
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-Given a role-play to illustrate the situation, 
demonstrate five “nursing assistant actions” in response 
to changes associated with the elderly. 

Methods : individual and small group activities, trainer 

presentations with guided discussions. 

• Handling Stress on the Floor (3 hours) 

Workplace Skills and Knowledge : 

-Developing self-directed learning 

-Building new vocabulary words and their meanings 

-Using the dictionary as a resource 

-Analyzing meanings through the use of quotations 

-Applying basic logic to analyze stressful workplace 

situations 

-Coping with and reducing stress 

Objectives : Upon completion of this module, learners 

should be able to: 

-Identify some positive and negative aspects of their 
work experience as new nursing assistants; 

-Identify potential sources of stress as well as their own 
specific stressors in the workplace; 

-Recognize specific effects that stress has on their own 
personal and professional behavior; 

-Describe and illustrate healthy and unhealthy ways of 
responding to stress in the workplace; 

-Explain and illustrate specific strategies for coping 
with stress in role-plays, case studies, and assignments 
taken from the floor and the workplace context; 
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-List in their professional portfolio at least two new 
vocabulary words or phrases presented in the module 
and identify their meanings. 

Methods : individual and small group activities, trainer 

presentations with guided discussions. 

• Communicating Effectively on the Floor (6 hours) 

Workplace Skills and Knowledge : 

-Developing self-directed learning 

-Building new vocabulary words and their meanings 

-Using the dictionary as a resource 

-Analyzing meanings through quotations 

-Obtaining and recalling essential information 

communicated orally by coworkers, supervisors, and 

residents 

-Responding to directions by listening for cue and key 
words and ideas 

-Presenting information clearly and logically in a 
variety of situations that involve staff, residents, and 
families of residents 

-Requesting help and information by asking appropriate 
questions 

-Interacting positively through verbal and nonverbal 
communication to the health care team and residents 
-Conducting oneself with courtesy and tact in the 
workplace environment 

-Recognizing the importance of communicating a 
professional image. 

Objectives : Upon completion of this module, learners 

should be able to: 
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-Identify the three components of basic communication; 
-List two purposes of communication on the floor; 
-Recognize barriers that adversely affect service 
delivery to residents and take steps to reduce 
communication blockers; 

-Enhance awareness of how personal behaviors 
interfere with the communication process on the floor 
and with residents; 

-Demonstrate how to ask effective questions to seek 
help and information from peers and supervisors; 
-Define “open” and “closed” questions; 

-Differentiate between hearing and listening; 

-Develop skill abilities to listen for “key” and “cue” 
words for prioritizing tasks in the workplace by 
listening to a taped shift report; 

Recognize the importance of mastering interpersonal 
skills to enhance professional image; 

-Identify the components and improve on one’s own 
professional image through increased skill awareness of 
verbal and nonverbal messages; 

-Distinguish between assertive, aggressive, and passive 
responses; 

-Given case scenarios for analysis and role-play, offer 
two solutions or techniques to achieve positive 
outcomes; 

-Given case scenarios for analysis and role-play, 
identify and list at least two positive and two negative 
elements of the interaction; 

-Given case scenarios for study, brainstorm potential 
strategies to solve communication problems; 

-List in one’s own professional portfolio a minimum of 
eight new vocabulary words, medical terms or phrases 
in the module and identify their meanings. 
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• Tier I: Easing into the Job - Home Health Care Aides (5 hours total), 
self-study modules (75 pp.) 

Topics : 

• Setting Priorities for Client Care (1 hour) 

Workplace Skills and Knowledge : 

-Self-directed learning 
-Reading workplace materials 
-Critical and analytical thinking 
-Decision making 
-Writing for self and others 

Objectives : Upon completion of this module, learners should be 
able to: 

-State personal and work goals and objectives; 

-Recognize the importance of choosing between 
alternatives; 

-Analyze workplace and work-related activities according 
to importance; 

-Rank activities based on their importance in meeting stated 
goals/objectives; 

-Recognize when plans need revision and to revise them. 
Methods : individual activities. 

• Controlling Time to Complete the Care Plan 

Workplace Skills and Knowledge : 

-Critical thinking 

-Reading/using workplace materials 
-Decision making 
-Self-directed learning 
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Objectives : Upon completion of this module, learners should be 
able to : 

-Identify how one’s time is used; 

-Use objectives and priorities to control time; 

-Schedule time in a useful way; 

-Identify and correct time wasters; 

-Identify and reduce procrastination and plan for change. 

Methods : individual activities. 

• Dealing with the Stress of the Home Care Setting 

Workplace Skills and Knowledge : 

-Self-directed learning 
-Critical thinking 
-Decision making 
-Writing for self and others 

Objectives : Upon completion of this modules, learners should be able 
to : 

-Identify stressors; 

-Identify stress symptoms; 

-Use a method to reduce stress symptoms; 

-Recognize barriers to change; 

-Conquer procrastination. 

Methods : individual activities. 

• Following Directions and Map Reading 

Workplace Skills and Knowledge : 

-Active listening 
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-Questioning 
-Critical thinking 
-Problem solving 
-Map reading 

Objectives : Upon completion of this module, learners should be able to: 
-Ask appropriate questions to get the information they need; 

-Draw written conclusions; 

-Write out directions; 

-Read and understand maps; 

Apply strategies to understand directions. 

Methods : individual activities. 

• Goal Identification and Priority Setting 

Workplace Skills and Knowledge : 

-Self-directed learning 
-Reading workplace materials 
-Critical and analytical thinking 
-Decision making 
-Writing for self and others 

Objectives : Upon completion of this module, learners should be able 
to: 

-State client, work, and personal goals; 

-Recognize the importance of prioritizing; 

-Analyze workplace and work-related tasks according to 
importance; 

-Rank tasks based on their importance in meeting stated goals; 
-Recognize when plans need revision and to revise them. 

Methods: individual activities. 
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• Tier II: New Directions in Customer Service - (20 hours total) Facilitator's 
Guide, including participant handouts for duplication, (80 pp. — in 3 modules 
available for review), videotape (90+ minutes). 

Topics : 

• Calling for Care: The Telephone in Customer Service (1 hour) 

Workplace Skills and Knowledge : 

-Using vocal control 

-Using appropriate language 

-Listening for information and emotion 

-Using questions to solicit and clarify information 

Objectives : Upon completion of this module, learners should be able to: 

-Identify behaviors that have the potential to cause breakdowns in 
telephone exchanges and customer service in select video 
scenarios; 

-List the most common guidelines for successful telephone 
communication; 

-Using the guidelines, offer suggestions for improving the success 
of telephone communication in select video scenarios; 

-Select and illustrate effective methods for providing internal and 
external customers with excellent customer service on the 
telephone using selected case scenarios; 

-Identify the Northeast Health Points of Service affected by 
telephone communication. 

Methods : trainer presentation with guided discussion, video segment 
presentations. 

• Taking Responsibility for Conflict (2 hours) 
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Workplace Skills and Knowledge : 

-Thinking analytically 

-Listening for key ideas and “trigger” words 

-Observing and interpreting nonverbal cues 

-Recognizing others’ points of view 

-Paraphrasing ideas 

-Responding to others appropriately 

Objectives : Upon completion of this module, learners should be able 
to: 

-Identify current and potential conflict situations at their worksites; 
-Identify their own most common styles and strategies for dealing 
with workplace conflict; 

-Differentiate between the “blips,” the “clashes,” and the “crises;” 
-Identify ownership for different conflict situations; 

-Identify and use appropriate strategies for resolving conflict better 
in the work environment, especially the 4-Step Approach; 

-Apply the strategies in simulated scenarios and work situations. 

Methods : trainer presentation with guided discussion and video tape 
presentations. 

• Dealing with the Stress of Change/ Rx for Stress Management (3 
hours) 

Workplace Skills and Knowledge : 

[unavailable for review] 

Objectives : Upon completion of this module, learners should be able 
to: 

-Define stress and stressors; 

-Identify personal sources of stress in their daily work 
environment; 



Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304)343-6861 FAX (304) 342-4996 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



24 



-Identify personal behaviors that occur in stressful situations in the 
workplace; 

-Recognize physical manifestations of stress; 

-Utilize simple relaxation techniques to control emotional 
reactions; 

-Apply stress reduction techniques to reduce on-the-job stress; 
-Recognize that change is a constant in today’s health care 
environment; 

-View self as the one in control of how one reacts to stress and 
change situations; 

-Enhance opportunities to view change as a creative and energizing 
process; 

-Develop two coping skills to handle the resistance of change. 

Methods : trainer presentation with guided discussion and video tape 
presentations. 

• [Additional Tier II modules, listed in syllabus, but not made available 
to external evaluator for review included: Seven Points of Customer 
Service (management overview, 2 hours); Conflict Resolution (1 
hour); Difficult People: Strategies for Maintaining Your Cool (3 
hours); Team Building (3 hours); Cultural Awareness/Diversity (3 
hours); Changes in the Health Care Environment (3 hours).] 

Staff-developed module print materials were desk-top published and laser printed 
with careful attention to uniformity of format, layout design, graphics, and high quality 
reproduction. Additionally, television-quality videotapes and interactive screens for 
electronic delivery on a home page for Web TV were prepared for use in training 
activities. Instructor scripts were provided, and revisions were made to each topic or 
session, based on feedback received. 
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Method 



Design : The evaluation of the Workplace Literacy Demonstration Project of the PDP and 
Eddy/Northeast Health partnership employed a modified version of the Context-Input- 
Process-Product (CIPP) model, (Stufflebeam & Guba, 1971). This model has been used 
to evaluate numerous workplace literacy programs across the country for the past 10 
years. It provides feedback for project stakeholders as a formative evaluation; and, data 
collected can be further analyzed to develop summative reports at the end of specified 
cycles of program operation. This method of evaluation was chosen by the evaluator as 
the most suitable tool for investigating the evaluation objectives, (see pp. 7-10), because 
it examines project effectiveness through structured analysis of the cohesiveness of 
project goals, components, and operations, independent from comparisons to outside 
standards or other programs. This premise works well within the emerging field of 
workplace literacy, as well as with demonstration projects, because of the uniqueness of 
each individual program that is developed. 



The CIPP model was used to analyze: 



• Context , i.e., the shared goals and philosophy of key personnel and 
participants; 

• Input , i.e., resources, including personnel, materials, time, and 
facilities; 

• Process , i.e., congruence of program development, operations, and 
observed instructional delivery with project goals and research on 
instructional effectiveness; and, 

• Product , i.e., indicators of program effectiveness and potential for 
program expansion and/or replication. 



It is important to note that, due to geographical considerations, much of the on- 
site data collection and project monitoring was conducted by the PDP project staff and 
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reported to the evaluator during site visits or via telephone or written communications 
from the Project Directors and secretaries. Forms and procedures for use in data 
collection across sites were developed and revised collaboratively by PPLC, the PDP 
project staff, and Eddy/Northeast Health Human Resources Vice President and training 
staff. 



Participants : The participants in the project were 1,452 trainees and employees of The 
Eddy/Northeast Health. Demographic data were made available to the external evaluator 
for 304 participants on Learning Strategies, Tier I, and Tier II program levels. A brief 
description of the available composite average participant profile (n - 304) is as follows: 



Composite Average Participant Profile 

Thirty-six to fifty year old, white female with an education level of 12 th grade. 




More detailed demographic information about participants is displayed in Figure 1 
below: 



Figure 1: Demographic Characteristics of Participants (n = 304) 



Age: 




Ethnicity: 




Gender: 
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28.3% 
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Instruments : Data for this evaluation were requested and gathered via pre-and post- 

program participant surveys; structured interviews with participants and 
supervisors/managers, trainers, administrators, and program personnel; focus groups with 
supervisors; and, formally-documented observations of instructional sessions and 
instructor training. Additionally, data were gathered from detailed analysis by the 
evaluator of program documentation, instructional materials, and participants’ work (i.e., 
pre-and post-assessment scores and participants’ records). 

Procedure : Following initial telephone and in-person conversations with the original and 
current Project Director to establish evaluation objectives, the evaluator conducted the 
activities listed below. Eleven site visits were made during the funding period: 



March 14-15, 1995; 

May 23-24, 1995; 

February 29-March 1, 1996; 
July 31-August 1, 1996; 
November 18, 1996; 
February 6, 1997; 

April 15-16, 1997; 

June 10-11, 1997; 
September 3, 1997; 
November 12-14, 1997; and 
January 20-22, 1998. 



Additionally, US Department of Education meetings for project orientation and 
discussion were attended on October 18-20, 1994; April 29-30, 1996; April 28-30, 1997. 



1. Development of Evaluation Data Collection Instruments: 



- Forms reviewed and modified for Participant Pre- and Post-Program 
Surveys, Instructor Interview, Participant Individual or Focus Group 
Interview, Classroom Observation, Trainer/ Administrator Interview, and 
Program Administrator Interview. 
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- Forms created for Performance Indicator Rating Scales with The Eddy/ 
Northeast Health supervisors and managers across shifts at the three 
facilities in which training was delivered. 

2. On-site consultation with Project Directors, Curriculum Developers, and PDP 
training staff; and The Eddy/Northeast Health HR Vice President, Training 
Coordinator and staff, concerning on-going instructional curriculum and 
assessment instrument development. 

3. On-site interviews with project and training managers, supervisors, trainers, 
and participants. 



4. On-site observations of learning activities during various cycles of instruction. 



5. Off-site analysis of materials and data collected from site. 

6. Communications and Operations; 

• Contract throughout grant period with project via telephone 
conversations with Project Directors, Christine Katchmar and 
Dorothy Negri, and Rockefeller College administrators, Eugene 
Monaco, Christina Mahoney, and Diane Tesiny to discuss project 
goals, progress, evaluation activities, and preliminary findings. 



• Interim Evaluation Reports submitted to Project Director, May 1996, 
March 1997, and October 1997. 

• Final Evaluation Report, submitted to Project Director, May, 1998. 




O 

ERIC 
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Results 



Project Context : 



To what extent are goals and philosophy of the project shared by key 
project personnel and participants? 



This section of the evaluation is a comparison of the project goals and priorities as 
reported in project descriptions and interviews with key project personnel, including: 



• project director; 

• business partners from The Eddy/Northeast Health 

• project curriculum developers/ instructor trainers; 

• managers, administrators, and trainers from The Eddy; 

• CNA and HHA supervisors from The Eddy; and, 

• participants. 



These viewpoints about project goals were analyzed for consensus and divergence, using 
the following probes as guidelines for data collection and interview questions: 



1. How have the goals of program instruction been defined? 

2. Is there a clear written statement to which all participants, instructors, and key 
program personnel subscribe? 

3. What beliefs about workplace literacy are promoted by the program? 

4. Are those beliefs documented and accepted by those who are a part of the 
program? 

5. Are those beliefs supported by current theory and research? 

6. Is there a clear statement of program objectives that delineates how instruction 
is to occur at different phases of the workplace literacy program? 

7. Is the workplace literacy program, as defined, compatible with the needs and 
characteristics of the participants and of the company it serves? 
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1 . .How have the goals of program instruction been defined? 

The published project goals and purposes are contained in the grant proposal 
submitted to the U.S. Department of Education, Office of Vocational and Adult 
Education. They were developed cooperatively following communication between 
the PDP and The Eddy, prior to applying for the grant monies. Stated goals in the 
proposal were: 

Goals : 

• to develop and demonstrate a workplace literacy program model for eldercare 
workers that is both effective for the specific context of the project, and 
transportable across the industry, including instructional design and materials; 
and, 

• to produce literacy gains among members of the Care Plan Team of The Eddy and 
its network of affiliates — the Certified Nurse Aides, the Home Health Care Aides, 
and the ancillary Housekeeping, Custodial, and Food Service staffs — in order to 
enable the Aides to complete the initial job training, and to enable all staff to 
perform literacy-related job tasks more effectively to increase job productivity. 

Specific Objectives : 

• to conduct a thorough workplace literacy task analysis of all targeted job 
categories across The Eddy and its network of affiliates; 

• to produce a 40-hour, two-tier curriculum in workplace literacy skills for Certified 
Nurse Aides, Home Health Care Aides, and ancillary staff of the Care Plan Team, 
the housekeeping and custodial workers, and the food service staff, that addresses 
the results of the task analyses and that will be partially video-based; 

• to deliver the 20-hour, Tier 1 curriculum over the three-year period of funding to 
all new hires in the targeted job categories across the network of affiliates 
(approximately 750 employees); 
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to deliver the 20-hour, Tier 2 curriculum over the third year of funding to all 
veteran staff, including those who received the Tier 1 instruction in the first and 
second years of funding (approximately 840 employees); 



• to tailor the existing 4-hour Learning Strategies module to the Nurse Aide and 
Home Health Aide new hire population to prepare them for their initial job 
training, and to deliver this module to all the new hires during the course of the 
three-year period of funding through a video-based module; 



• to develop and administer a workplace literacy skills assessment that will inform 
instruction and be used as the basis for Individual Education Plans; 



• to design a process for the development and implementation of the Individualized 
Education Plan for each new hire, that will incorporate a role for The Eddy’s 
human resource and training functions; 







to develop a 4-hour orientation and instruction program for supervisors of the 
targeted workers; 



• to develop — through the supervisory staff of the targeted categories of workers, 
through The Eddy’s human resource counseling function, through Literacy 
Volunteers of America of New York State local affiliates, through the 
establishment of learning resource centers within the physical plant of and its 
network affiliates, and through a peer “buddy” system — the capacity to provide 
ongoing support to the targeted workers after their initial training; 

• to develop and periodically administer workplace literacy assessment and 
evaluation measures that will yield quantitative data to examine the effects of 
instruction; 



• to produce, through an outside evaluator, an analysis of the overall effectiveness 
of the proposed program with respect to the immediate target population and the 
industry within which it is implemented; 
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• to make the curriculum design and materials available to the adult literacy field 
and the eldercare industry through conference presentations, professional 
gatherings, and various publications. 

PPLC conducted structured interviews with key program personnel to gather goal 
statements. The following program personnel were interviewed: 

■ Dr. Eugene Monaco, Rockefeller College 

■ Christine Katchmar, Christina Mahoney, and Dorothy Negri, Project 
Directors, Rockefeller College 

■ Barbara McCandless, HRD Director, The Eddy 

■ Project Curriculum Specialists 

■ Project Instructors 

■ Project Administrative Assistants 

■ Managers, The Eddy 

■ Project Participants 




In interviews with key project personnel during the first year of project 
operations, the respondents provided answers that indicated complete concurrence 
and support for all project goals and for implementation of those specific 
objectives related to project operation activities. During the course of the project, 
the project experienced turnover of the Project Director, the Curriculum 
Developers, the Project Instructors, and a merger of The Eddy with another health 
care organization. Northeast Health. These changes resulted in subtle differences 
in the focus of the goals and objectives for curriculum content, delivery, and 
purpose. 



2 . 




Is there a clear written statement to which all participants, instructors, and key 
program personnel subscribe? The published goals of the project listed in the 
program proposal serve this function. Initial interviews with key program 
personnel evidenced that they subscribed to these goals. As the project went 
forward, several of its specific objectives needed to be revisited and revised, due 
to changes in organizational structure and training policies. 
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3. 



What beliefs about workplace literacy are promoted by the program ? Based upon 
the published goal statements and the responses of key project personnel, there is 
evidence that the following beliefs about workplace literacy were being promoted 
by the program: 



• program should meet needs identified by employer and employees 

• use of a functional context approach in development of instruction 

• outcomes measured as impact on job performance and identified job needs 



4. 




Are those beliefs documented and accepted by those who are a part of the 
program? Based on documentation and observation of program activities, there is 
evidence that the program beliefs listed under question 3. Above are accepted by 
those who are a part of the program staff. Additional data was collected 
throughout the program to determine participant beliefs and their acceptance of 
program beliefs. Fewer than 3% of all participants felt that the program had NOT 
helped them work toward personal goals and objectives and 99% reported that 
they would recommend the program to coworkers or staff. (Please see Product 
topic in this section for a more detailed description.) 



5. Are those beliefs supported by current theory and research? The program beliefs 
are supported by current cognitive psychology and learning theories and research, 
indicating that transfer of learning from training situations to job performance is 
greatest when training context most nearly matches that of actual job situations. 
This program uses the results of literacy task analyses as the context in which 
targeted skills for instruction are embedded, thereby allowing participants to 
experience skill learning and practice in job context, and thus promote greatest 
impact of training on subsequent job performance. 



The program content and instructional objectives initially stemmed directly from 
information gathered from past trainees and from EDDY staff. The performance 
indicators identified by EDDY staff with assistance from PPLC during the first 
year, and used as guidelines for analyzing responses to post-program 
questionnaires and structured interview questions, indicated upon analysis that the 
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instruction produced for use during year one of the project (in Learning Strategies 
and Easing into the Job courses) was directly related to those cognitive strategies 
and skills necessary for performance of critical job tasks. 

6. Is there a clear statement of program objectives that delineates how instruction is 
to occur at different phases of the workplace literacy program? Program 
instructions delineating how instruction is to occur at different phases of the 
project were clearly outlined in the project proposal, with steps, activities, and 
objectives listed for each year of planned program operations. 

7, Is the workplace literacy program, as defined, compatible with the needs and 
characteristics of the participants and of the company it serves? The goal 
statements collected from company personnel and the information gathered from 
focus group sessions held with company employees at the onset of project 
operations are reflected in the curriculum materials that were developed. 
Company reactions to these programs were very positive and indicate acceptance 
and approval of both the content and format of instructional materials in 
correspondence with company program goals. Tier II curriculum, New Directions 
in Customer Service, was developed in direct response to The Eddy/Northeast 
Health’s need for system-wide consistency in training at all affiliates following 
their merger. The translation of Tier I modules for delivery on the Internet via 
Web TV was also in response to The Eddy/Northeast Health’s request for more 
flexible delivery of training, especially for Home Health Care Aides. 

Project curriculum developers and trainers were interviewed individually during 
one or more of the site visits throughout the entire demonstration period. The goals 
expressed during project start-up and the first year of project operations centered around 
providing CNAs and HHAs with tools that would enable them to gain competence in 
critical tasks required for job performance and job retention. One developer commented 
on the importance of having an impact on participants’ self-perceptions. Another 
mentioned providing motivation toward life-time learning and empowering participants 
through skill acquisition and/or mastery to better cope with their job responsibilities. 
After the first year of operations, project development and training staff experienced tum- 
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over, which resulted in some movement away from the original instructional design that 
closely adhered to teaching those human information processing strategies that had been 
identified during the job literacy task analyses that had been conducted at the onset of the 
project. When interviewed, replacement curriculum developers and trainers frequently 
commented on the importance of teaching the content of the job and what to do, rather 
than the previous instructional emphasis on the mental steps involved in how to do. 

Eddy Supervisors of CNAs and HHAs were interviewed in focus groups at the 
Eddy Cohoes Rehabilitation Center, the Eddy Memorial Geriatric Center, and the 
Heritage House Nursing Center facilities during the May, 1995 site visits. Each group 
identified new-hire CNA or HHA attributes and specific observable behaviors that could 
serve as performance indicators for measuring the impact of the project training on job 
performance. The six supervisors who participated in the Heritage House focus group 
suggested the following attributes as those of highly competent health care aides: 

• being organized 

• being able to think of what to do 

• displaying respectfulness 

• communicating well 

• showing empathy 

• being consistent and dependable 

• displaying flexibility 

• having a positive attitude 

• taking pride in work 

• 

For each attribute, the supervisors then identified specific behaviors to create “snapshots” 
of highly competent and less than competent aides, to create lists with which aides could 
be compared and rated before and after training with the Essential Skills for the Care 
Team workplace literacy program. The observable behaviors they selected for the 
attribute of Being Organized are listed on the next page as an example: 



Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



36 



Highly Competent CNAs 


Less than Competent CNAs 


• Has everything needed before starting task. 

• Completes routine in timely manner. 

• Works at good, steady pace, not rushing 
around. 

• Gets to all the residents. 

• Makes self available to help coworkers 
whenever he/she is needed to assist. 

• Reacts quickly to changes; able to prioritize 
tasks in new order to accommodate changes. 

• Has resident ready for programs and meals 

• Initiates checks with nurses for daily goings on, 
changes in schedule, etc. 

• Demonstrates ability to organize all the 
multiple pieces of his/her job — meal times, 
resident treatments, showers, beauty parlor 
appointments, family visits, etc. 


• Leaves tasks half completed at end of shift. 

• Makes comment, ‘Til have to do that later.” 

• Repeatedly runs back and forth all over the 
floor to get items needed to complete routine 
tasks. 

• Usually has assigned residents unwashed or not 
dressed when it is time to go to appointments or 
meals. 

• Appears in a state of chaos all of the time, e.g., 
runs to RN all of the time saying, “Oh, my 
God — I’ll never get done, never get my break. 

• Always appears frazzled, disheveled, with 
unironed uniform, making 20 trips instead of 5, 
etc. 



Ten other CNA supervisors participated in the focus groups at the Eddy Cohoes 
Rehabilitation Center and the Eddy Memorial Geriatric Center during day and night 
shifts. They identified the following attributes as those of a highly competent aides: 



• communicating honestly and directly 

• displaying politeness 

• being cheerful and happy in work 

• being patient-oriented 

• following directions consistently and reliably 

• asking appropriate questions 

• taking initiative when knowing things need to be done 

• following through on minor issues 

• recognizing needs 

• making suggestions based upon past experience 

• assuming leadership among peers 

• working through the “chain of command” 

• being responsible 

• going one step further than what is expected 

• having general concern for patient well-being 

• being a team player 
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The attributes listed each represent health care aide qualities commonly valued by 
The Eddy supervisors. The lists each group generated were then compared with the 
Essential Skills for the Care Team curriculum to determine which performance indicators 
the supervisors listed as goals for aide behaviors on the job correlated with those of the 
training program. Although not necessarily taught directly during program instruction, 
the basic skills applications that were taught are, in fact, imbedded in the competent 
performance of the behaviors that demonstrate the attributes. For this reason, the 
performance indicators listed by the Eddy supervisors are valid measures of the transfer 
of learning from program instruction to job performance. Copies of the instruments 
developed are contained in the Appendices. 

Goals of training participants were collected in individual interviews during site 
visits and on pre-program and post-program surveys administered by project staff for 
each Tier II training session conducted. On pre-program surveys, participants responded 
to the question, “What do you expect to gain from this training?” A sampling of the 
responses from the survey used for the New Directions in Customer Service Telephone 
module, Calling for Care, are listed below. The responses include a range of participant 
expectations for the course. For a complete list of responses and comparisons by 
participant to post-course survey responses detailing what each respondent felt they 
actually gained from the training, please see the Appendices. 



Participant Goals for Essential Skills for the Care Team Training 
Tier II: New Directions in Customer Service— Calling for Care ( Telephone module) 


How to handle a rude patient, customer, etc. and what and how to approach them. 


How to stay cool — better communication skills 


New ways to handle difficult clients and ways to deflate angry clients and people 


Answering phone and taking messages so everyone understands request. 


Proper telephone skills regarding our department 


Phone etiquette 


Proper telephone techniques 


How to maintain the telephone for calling for care on it « 


How to properly answer the phone in different situations. 


I like doing nursing aide, doing the care, looking out for people, giving good care. 


How to call for help on the telephone 


Getting along with coworkers, customers, people in general; communications. 


Don’t know 
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How to answer the phone properly 


Good attitude 


How to handle others 


How to deal with people and working together 


Politeness 


Everything 


How to handle conversations in regarding your job service at the facility you work at and being patient 


Better cash register skills 


I don't speak English and don’t use the phones. 


How to answer phone properly 


How to answer the phone in the right manner 


How to answer the phone correctly 


I have no idea ?????? 


How to answer and be assertive on the phone; why and how to take your job seriously; Be polite, even 
when you are pissed; Don’t jump to blame something on one specific person. Stay calm, even when people 
are assholes. 


Customer service skills for telephone 


The use of telephone skills for customer service 


Telephone etiquette 


Don’t know 


Phone skills 


How to answer the phone properly for a business 


How to answer the phone properly and communicate 


Don’t know 


Appropriate responses and mannerisms of conduct when conversing over the phone or whenever phone 
usage is required 


I am willing to learn anything new. 


Everything that I do on my job has to do with people that I work around. Also my work duties are 
answering phone 


I expect to review telephone customer service and how [facility name] would like us to answer the phone. 


How to deal with angry customers; how to help them calm down and end up assisting them 


How to “handle” and upset person who calls back after receiving wrong information from a previously 
made call. How can I reassure them and guide them to the correct information and contact person while 
easing their frustration. 


How to effectively communicate with aggravated customers over the telephone; how to stay friendly and 
avoid retaliations 


How to stay in control and remain professional during a heated conversation with an angry customer. 


To learn to react and deal with situations on hand, when the patient becomes angry or combative, to deal 
with the “difficult” people. 


How to answer the phone politely; give and receive information quickly and accurately 


To learn how [facility] expects me to answer the phone and approaches to use in dealing with situations to 
do this in a timely manner. 


Self esteem conversations over telephone; being polite, giving your name, position and what your need or 
wants are. Having a good attitude over the air waves 


How to communicate with the telephone services; to answer the phone properly and to understand how the 
phone system works 


Telephone answering — properly; Dealing with angry customer or family member. 


Making phone calls with pleasant voice and good attitude 
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How to deal with behaviors 


How to deal with angry customers 


How to handle interactions with customers so as to prevent interactions from getting “hot”; how to project 
the best professional image for the organization 


Good customer service 


How to effectively deal with angry customer; best response to use; things that won’t work 


To give better knowledge on dealing with customers and their anger, and to be able to deal with all 
situations regarding customers 


Working with our clients 


Agency specific protocol 


I expect to learn more about communicating better and I would also like to further my education with the 
telephones by asking more questions 


How to effectively deal with unhappy clients 


Better and proper way to deal with certain customers 


How to handle people and problems 


Telephone service skills 


How to deal with a customer that is upset or unsatisfied 


To see how other people react to phone conflict 


How to better serve customers on the phone; how to deal with problem callers 


How to handle abusive callers and project good telephone manners in all situations 


How to ask about particular residents care; learn to direct efficiently. 


I expect to learn proper phone etiquette and how to handle “problem cases” 


To learn a more efficient way of answering the phone; learning techniques for phone services 


How to handle a rude patient, customer, etc. & what and how to approach them 


Phone readiness for customer support; how to stay calm with an angry customer; how to diffuse a situation. 


Hopefully how to handle and deal with all customers — how to deal with them in a professional manner- 
no mater how angry they get 


How to help callers not go through 3-4 people before reaching the right party; 1 like reviewing. 


How to effectively handle an angry customer 


I hope to review techniques on how to handle the stressful calls that may be received from angry patients 
(what to say or not say) 


How to handle difficult customers who won’t hang up 


How to deal with angry people or frustrated people on the phone or in person. How to get better results 
from your conversations. 


How to better handle customers who call and are upset about their bills. 


How to deal with people over the phone 


Expect to learn how to deal more effectively with difficult people on the phone 


Techniques as to the best way to handle upset customers 


How to defuse a problem to get the patient or person to explain their problem so that I can quickly get them 
to the proper person to help them. There is always room for improvement; Not every person can handle the 
same. 


Strategies to defuse “angry” customer situations; ways to seek resolution that makes all customers feel like 
a winner; insight into “whys” — who do customers become angry — prevention of “root” causes for 
customer anger will decrease # of angry customers and give employees a knowledge base 



PPLC collected and analyzed goal statements from the project director, managers, 
trainers, curriculum developers, supervisors, and participants. For a discussion of areas 
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of convergence and divergence, please see the evaluation section, “Summary of Results,” 
under Discussion . PPLC next investigated the input of resources to the project, which is 
addressed in the next section of the evaluation. 
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Project Input : 



What resources were available to the project during development and 
implementation and to what extent were they used effectively? 

This section of the evaluation addresses major resources of the project. It 
includes program instructional materials, design and appropriateness for the targeted 
participant population; key personnel qualifications and the match between published 
project duties; and facilities. It also examines the content and processes used for 
instructor training. The data presented in this section were analyzed for strengths and 
weaknesses, using the following probes to guide the investigation interview questions and 
data collection; 



1 . 




2 . 

3 . 

4. 



5 . 

6 . 



7 . 



Are the workplace literacy program materials consistent with its stated philosophy 
and goals? 

Are adequate materials available for all phases of the workplace literacy program? 
Do the workplace literacy materials and instructional techniques accommodate 
the literacy levels of the program participants? 

Are instructors adequately trained to implement all phases of the workplace 
literacy program? 

Are effective support services readily available to participants who need them? 

Is the learning facility planned and equipped to support the workplace literacy 
program? 

Is the workplace literacy program record-keeping system complete, simple, and 
efficient? 



1 . 




Are the workplace literacy program materials consistent with its stated philosophy 
and goals? The instructional materials for Learning Strategies and Tier I, Easing into 
the Job , were designed for use with the Essential Skills for the Care Team program 
after developers conducted extensive literacy task analyses of CNA and HHA training 
tasks and new hire job tasks at the beginning of the funding period and during year 
one. The three curriculum developers from PDP toured each of The Eddy facilities, 
interviewed supervisory and administrative personnel, and interviewed and observed 
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CNAs and HHAs as they performed job tasks. A total of 116 hours was spent in 
literacy task analysis on site at various Eddy facilities and an additional 136.5 hours 
in information gathering with Eddy staff and workers. The developers also collected 
job materials used by CNAs and HHAs and carefully reviewed existing training 
materials for both groups. In addition, the developers attended Eddy training courses 
on presented by The Eddy training staff. Sample documentation of the literacy task 
analysis was made available and program developers spoke knowledgeably about the 
procedures they had used for interviewing and observing CNAs and HHAs, 
supervisory and managerial personnel, and Eddy CNA and HHA trainers. They also 
explained in detail their methodology for analyzing materials to determine basic skills 
applications used in CNA and HHA job task performance. 



Based on discussions with CNA and HHA certification and orientation trainers and 
managers. The Eddy Director for Human Resources, and the first Project Director, the 
choice of basic skills applications contained in instructional content and objectives in 
Learning Strategies and Easing into the Job was that identified as necessary to 
support participants' performance of targeted job tasks and procedures. 

Review of the curriculum at all three levels of instruction revealed numerous job 
scenarios and examples taken from CNA and HHA certification training and 
workplace situations that corresponded with the objectives of existing Eddy training 
for these job groupings of new hires. Instructional materials and the workplace 
examples they contained were reproduced at a high level of quality and were up to 
date. The workplace materials, such as assignment sheets and policies, were selected 
to be representative formats with a high degree of similarity (in information contained 
or requested) to those used at the health facilities. Because the CNA and HHA job 
materials are a "given" at any facility or agency, they were not analyzed for reading 
difficulty (grade) levels. Rather, the developers chose to provide instruction in 
Learning Strategies and the first two modules of Easing into the Job in the cognitive 
strategies that enable applying basic skills to operations with specific formats for 
certain functions, (i.e., translating medical abbreviations or prioritizing multiple tasks 
by time order and recognizing cause-effect relationships). This functionally 
contextual approach enabled participants to validate and build on prior experiences 



ERjt 
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while focusing on improvement of transferable cognitive strategies. This allowed 
trainees and new hires to apply basic skills application processes to appropriate job 
tasks through schema, or experiential memory classification and recall. 

Results of the analysis of Tier I Easing into the Job modules three through six and the 
Tier II New Directions for Customer Service curriculum indicated that there was a 
marked decreased emphasis on providing instruction in the cognitive processes 
utilized by competent employees to apply basic skills to the performance of 
workplace tasks. The focus of these modules, based on examination of learning 
objectives and content of instruction, centered on technical content of the job and/or 
current industry “pop-training” in soft-skill topics. For example, sample learning 
objectives for module two of Easing into the Job, “Understanding Your Assignment 
Sheet,” are as follows: 



Recognize and understand the meaning of abbreviations commonly used at long- 
term-care work sites; 

State and explain the use of specific strategies to learn unfamiliar abbreviations : 
‘Translate” abbreviated directions into complete statements about resident care at 
the worksite. 



These objectives of outcomes directly refer to mental strategies to be learned by the 
participant to use when applying basic skills ( e.g ., using context clues in listening and 
reading unfamiliar — medical — terms and abbreviations) to workplace tasks (e.g., 
reading the daily assignment sheet containing directions for patient care). 

In contrast, sample learning objectives for module three of Tier II New Directions in 
Customer Service, ‘Taking Responsibility for Conflict,” are as follows: 

• Differentiate between the “blips,” the “clashes,” and the “crises;” 

• Identify ownership for different conflict situations; 

• Identify and use appropriate strategies for resolving conflict better in the work 
environment, especially the 4 - Step Approach. 
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These objectives of outcomes directly refer to knowledge-based information, or the 
what, rather than to cognitive strategies in which learners acquire the how, or mental 
processing, that enables application and transfer of basic skills to performance. 

The series of workplace vignettes on videotape, utilized in Learning Strategies and in 
Tier II New Directions in Customer Service, were of high quality. Numerous 
revisions after draft piloting, ensured that the vignettes accurately depicted the 
workplace environment and example tasks. Many of the vignettes displayed 
problematic task performance followed by correct task performance with over- 
voicing and captions that encouraged participants to respond to representative 
common workplace situations and identify those areas in which individual 
participants needed to focus their improvement efforts. Due to training time 
constraints, Learning Strategies and Tier II New Directions in Customer Service used 
reflective self-appraisal as a means for measuring participant gains. Tier I Easing 
into the Job modules utilized identical knowledge-based pre-tests and post-tests to 
measure participant gains. 

2. Are adequate materials available for all phases of the workplace literacy program ? 
Materials have been developed for all three phases of project. The videotapes and 
materials for Learning Strategies and Easing into the Job appeared to be adequate 
and appropriately designed in the areas of time, level of difficulty, and media used for 
the purposes and context in which they are used. Comments from participants and 
supervisor overviews of New Directions in Customer Service modules appeared to be 
presented in less time than needed for content to be processed and absorbed. (Please 
see Appendices for additional detail.) Because there were no pre- or post-tests 
included in the design of Tier II modules, it is not possible to determine 
appropriateness of the difficulty level for these materials. 

The schedule for curriculum development for the three levels of instruction and 
accompanying videotapes called for components to be prepared and field tested 
incrementally across the life span of the funding period. None of the curriculum 
writers mentioned difficulty in adhering to the time lines for deliverables; however, 
the second Project Director reported concern that the extensive planning and revisions 
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to the Tier II videotape segments required by The Eddy/Northeast Health trainers 
during the co-development process might limit the number of incumbent workers able 
to be trained during the funding period. Toward the end of the funding period, the 
second Project Director and The Eddy/Northeast Health training coordinator agreed 
on the recognized need for the program materials to be finalized and extensive 
training ensued. 

3. Do the workplace literacy materials and instructional techniques accommodate the 
literacy levels of the program participants? Although literacy levels of participants 
were not formally measured by the external evaluator, examination of the materials 
indicated that they were written/spoken at an intermediate level of literacy. 
Observation of participants using the video tape and study guides in two courses 
identified no participant having difficulty or appearing bored. This would indicate 
that the level of instruction is appropriate for the targeted participants. 

When asked about the strengths and weaknesses of instructional materials, the 
majority of the participants responding thought the content reinforced the skills they 
needed. Ninety-seven percent of the program participants who completed post- 
program surveys reported that the program materials were extremely to moderately 
interesting; and seventy-eight percent reported that the instruction was extremely 
useful on the job (n = 213). Eighty- four percent also reported that the materials were 
easy to use and relevant to their goals, and eighty-five percent reported that the 
program was exactly what they had expected and needed. 

4. Are instructors adequately trained to implement all phases of the workplace literacy 
program? Developers were seasoned teachers and professors with expertise and 
years of experience in adult basic education, higher education, assistance to public 
agencies, public program management, and developmental studies. Initial curriculum 
design and developer credentials and experience include Ph.D. and Masters degrees 
with extensive additional studies and teacher certification. Two of the original 
developers had previous experience with creating functional context workplace 
materials and all had curriculum development experience. The first project director, 
Christine Katchmar, has a Masters degree and additional graduate work in 
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communications and English and extensive experience in administering training 
programs for instructors working with youth in public agency endeavors. The second 
project director, Dorothy Negri, has extensive experience in supervision of 
development and delivery of entry-level employment and organizational restructuring 
training programs for public agencies. 

The curriculum developers and project director hired at the beginning of the grant 
served as instructors during the pilot phases of instruction conducted during year one 
of program operations. Because of their intimate involvement with the development 
and refinement of instructional activities, staff training was unnecessary for 
implementing program instruction. As project instructional activities increased and 
personnel turnover occurred, however, no specific training sessions were provided to 
prepare new personnel for continuing with curriculum development and/or delivery in 
accordance with the philosophy and stipulations contained in the project proposal. 

Instructor scripted guidelines were developed and provided to instructors and trainers 
for each of the modules in all three levels of instruction, providing uniformly 
formatted directions for preparation and delivery of content. Each module contained 
a rationale and goal statement explaining the use of the applied skills in the workplace 
or workplace training; a list of learning objectives; a list of competencies; and an 
overview of training materials and delivery needs that included an outline of the 
contents of the trainers’ guide pages, the participant materials, method of evaluation, 
description of physical setting and instructor preparation tasks, and a list of 
equipment and supplies needed. (Please see pages 12-24 of this report for additional 
details.) 

The PDP staff involved Eddy/Northeast Health trainers in field tests and pilots of the 
curriculum modules whenever possible. Following delivery of training, the 
Eddy/Northeast Health trainers or administrators often sat with the program 
developers and provided constructive feedback on the materials and activities. 

Formal train-the-trainer sessions were conducted by PDP curriculum developers for 
the initial CNA and HHA certification and training instructors who will be 
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responsible for delivery of Learning Strategies and the Tier I Easing into the Job 
modules following the funding period. Tier II New Directions in Customer Service 
was co-developed and taught by paired trainers from The Eddy/Northeast Health and 
the PDP, so no formal training on post-grant operations delivery was deemed 
necessary by those responsible. 

5. Are effective support services readily available to participants who need them? The 
EDDY provides counseling to program trainees as needed. The workplace literacy 
course instructors are well- versed in referrals to community-based tutoring programs, 
if participants demonstrate a need for such services. 

6. Is the learning facility planned and equipped to support the workplace literacy 
program? The learning spaces provided in various network affiliate locations in 
which program classes were observed being conducted are the same one used by the 
EDDY for job training. All were well-lit with adequate seating, tables, and resources 
(e.g., VCR and monitor, boards, instructor desk, etc.) for conducting planned 
workplace literacy training activities. Although instruction is delivered in eldercare 
facility areas, such as the kitchen area adjacent to the physical therapy room, 
participants had adequate space to work on learning activities and appeared 
comfortable with their surroundings. When asked during on-site visits, "What is your 
assessment of the facilities in terms of supporting your learning or making it more 
difficult?" instructors reported that the facilities were "somewhat cramped and 
sometimes ad hoc (e.g.., using a physical therapy room as a classroom)" but met their 
needs. 

7. Is the workplace literacy program record-keeping system complete, simple, and 
efficient? The record-keeping system changed in format and scope numerous times 
throughout the project. Initially somewhat complex, it required project staff to enter 
information into a computerized application, then mail the information to the agent 
for the US Department of Education for analysis. There were frequent difficulties 
and bugs reported by staff needing to use this system. The administrative assistant 
kept a trouble log, listing 33 problems that occurred during just under 2 months time, 
from the end of January, 1996 through most of March, 1996. Information collected 
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did not address local formative evaluation information needs, but consumed much 
time during instructional periods and in office man-hours. This data collection, albeit 
insufficient in content and output, supplanted the usual data collection required by the 
external evaluator as well as instructor and staff typical workplace literacy record- 
keeping because of the burdens it imposed on the project staff’s time. During year 
two of project operations, the US Department of Education ceased requesting this 
computerized data from project sites. During the same period of time, the initial 
Project Director noted that the curriculum design had needed to be revised from 20 
hours of instruction per tier to sequential modules of one to three hours duration in 
order to accommodate the amount of time available for training of The Eddy 
participants. For this reason, the external evaluation data collection instruments were 
abbreviated to comply with reduced instructional (and data collection) time. For the 
remainder of the project, the abbreviated pre-/post-surveys were used to collect data 
from participants. (Please see the Appendices for examples of the various data 
collection forms used throughout the project.) 



For a discussion of strengths and weaknesses of available project resources and 
the effectiveness of their use, see "Summary of Results" under Discussion section of the 
evaluation. The next section of this evaluation examines the process of project delivery. 




Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 

May, 1998 

49 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



49 



Project Process : 



To what extent were program operations, development and observed 
instruction congruent with project goals and research on instructional 
effectiveness ? 



This portion of the evaluation report examines program operations, development, 
observed instruction, and daily activities to determine their level of congruence with 
project goals and current research on effective workplace literacy, using the following 
probes to guide interview questions, data collection, and data analyses: 



1 . 

2 . 

3. 




4. 

5. 

6 . 
7. 



Are current records of routine program activities in the workplace literacy 
program maintained and do these activities reflect stated goals? 

What are each participant's current progress, instructional activities, and learning 
needs? 

Are the workplace literacy program instructional decisions and activities 
generally consistent among instructors who have similar responsibilities or who 
serve the needs of similar participants? 

Are participants in the workplace literacy program making the progress that was 
anticipated? How is this determined? 

How much time is spent in instruction with workplace literacy program 
participants in whole group, small group, individual formats? 

Are the workplace literacy resources planned for use actually being used? 

Is there a need for additional resources not initially planned for? 



1 . 




Are current records of routine program activities in the workplace literacy program, 
maintained and do these activities reflect stated goals? Records of routine program 
activities include attendance, pre- and post-test course test scores, and minutes/reports 
from meetings conducted with the EDDY. As stated above (Input, Point 7.) the 
federally mandated computerized record-keeping system used initially to record data 
proved to be inadequate and flawed. Other program records, recorded manually by 
project staff in a variety of formats were kept on file for local access and for review 
by the external evaluator. Copies of those documents received by the evaluator for 
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documents received by the evaluator for review displayed included attendance 
records, monthly activity reports, class activity reports with brief instructor 
comments, computer-generated pre/post test scores for individuals, and sample 
minutes from monthly project meetings held by the PDP and Eddy partners. 
Attendance records documented numbers participants and numbers of sessions 
attended. Monthly activity reports detailed dates, times, locations, types and names 
of activities, personnel involved, in-kind contributions, and brief descriptions of 
events. Class reports. Copies of all monthly activity reports and samples of all other 
documents were sent to the external evaluator for review. 

The project partners, represented by the Project Director from PDP and the Human 
Resource Director from The Eddy, met weekly during the first few months of 
operations, then bi-monthly or monthly, with other key project personnel, depending 
on issues to be addressed and availability of representatives from each of the 
partnering agencies. Sample minutes were reviewed and five meetings attended by 
the external evaluator. (Attendance by external evaluator noted with an asterisk--*— 
below.) A total of 79 meetings were held on the following dates: 



January 4, 1995 


March 6, 1995 


June 19, 1995 


August 29, 1995 


January 8, 1995 


March 15, 1995* 


July 11, 1995 


September 5, 1995 


January 24, 1995 


April 3, 1995 


July 18, 1995 


September 14, 1995 


February 2, 1995 


April 24, 1995 


July 20, 1995 


September 25, 1995 


February 10, 1995 


May 12, 1995 


July 25, 1995 


October 19, 1995 


February 16, 1995 


May 25, 1995 


August 22, 1995 


October 20, 1995 



[Continued] 



November 14, 1995 


July 18, 1996 


October 16, 1996 


December 23, 1996 


January 18, 1996 


August 1, 1996* 


October 21, 1996 


January 7, 1997 


February 29, 1996* 


August 9,1996 


October 28, 1996 


January 16, 1997 


March 19, 1996 


August 20, 1996 


November 5, 1996 


January 23, 1997 


March 22, 1996 


September 3, 1996 


November 14, 1996 


January 24, 1997 


April 25, 1996 


September 12, 1996 


November 18, 1996* 


February 4, 1997 


May 9, 1996 


September 18, 1996 


November 25, 1996 


February 6, 1997 


June 7, 1996 


September 30, 1996 


December 2, 1996 


February 18, 1997 
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July 15, 1996 


October 15, 1996 


December 16, 1996 


March 6, 1997 



[continued] 



March 20, 1997 


April 30, 1997 


August 1 1, 1997 


December 4, 1997 


April 7, 1997 


May 30, 1997 


September 12, 1997 


December 5, 1997 


April 15, 1997* 


June 4, 1997 


September 19, 1997 




April 21, 1997 


July 15, 1997 


October 16, 1997 





Agenda topics indicated that key issues addressed during these meetings included 
planning, review, and revisions of time lines and work plans for project activities and 
product development; identifying and clarifying skill objectives for Essential Skills 
for the Care Team curriculum; clarifying evaluation objectives; and exploring and 
implementing The Eddy/Northeast Health institutionalization activities. Attendance 
of agency representatives at meetings varied from one to ten participants, depending 
on topics of discussion. Additional meetings were held with facility administrators, 
. supervisors or workers and Project Directors or curriculum developers to address 
specific topics, such as instructional implementation and scheduling within a facility. 

2. What are each participant's current progress, instructional activities, and learning 
needs? From the electronic records kept during the first half of project operations, it 
was possible to determine only the title of the course in which a participant was 
enrolled, the dates of offering, the location, the names of the trainers, the number of 
learners, the number of sessions offered and attended, and whether or not the course 
was completed by the participant. This data did not inform program personnel about 
each participant’s current progress in mastering materials taught, in instructional 
activities, or identify ongoing learning needs. Pre- and post-course assessments 
completed by participants in the Learning Strategies sessions allowed participants to 
rate themselves on their progress in mastering concepts taught. Easing into the Job 
two- to three-hour curriculum modules each contained a knowledge-based instrument 
that was administered as both a pre-test and post-test. Multiple versions of these 
module tests were used during project operations. A pre-/post-course participant 
survey form, based on perceptions and self-reflection, was used to gather information 
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immediately before and after instruction for all New Directions in Customer Service 
modules and orientation courses for supervisors. 

3. Are the workplace literacy program instructional decisions and activities generally 
consistent among instructors who have similar responsibilities or who serve the needs 
of similar participants? Initially, the curriculum developers and first project director 
served as instructors during the pilot phase of Learning Strategies and the first two 
modules of Easing into the Job. The pilots were conducted from fully developed, 
uniformly formatted instructor guidelines and participant materials, which were 
revised based on feedback from participants and The Eddy staff. Despite to staff 
turn-over and program expansion following piloting of curricula, the professional 
packaging of these instructional activities and the decisions related to their delivery 
facilitated consistency of delivery throughout the project. The other three modules 
contained in Easing into the Job , the Tier I modules customized for Home Health 
Care Aides, and the Tier II modules (New Directions in Customer Service ) reflected 
some changes in instructional and training philosophy that coincided with turn-over 
in PDP project personnel and organizational restructuring. These products also were 
uniformly formatted with fully developed instructor guidelines and participant 
materials; and , following piloting and minor revisions, were also delivered with 
consistency throughout the remainder of project operations. 

4. Are participants in the workplace literacy program making the progress that was 
anticipated? How is this determined? A thorough analysis of job competencies was 
provided by the partnering agencies prior to the onset of each phase of training 
development. In addition, the PDP conducted a rigorous front-end analysis of job 
tasks and the literacy skills that support their performance. The PDP also studied 
existing Eddy training courses in depth to ensure that the new Essential Skills for the 
Care Team program would enhance and integrate with currently available training. 
The participants completed assessments after each module in all three levels of 
instruction that course developers and instructors carefully analyzed to determine the 
extent to which stated instructional objectives were being covered and met. Please 
see point 3 above for additional detail on instruments, samples of which are contained 
in the Appendices. 
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5. 




How much time is spent in instruction with workplace literacy program participants in 
whole group, small group, individual formats? In the Learning Strategies and Easing 
into the Job sessions conducted during the project were 1 to 3 hours in length and 
often were delivered on sequential days. Participants were all CNAs or HHAs in 
training or new to the job. New Directions in Customer Service sessions were 
delivered to groups of incumbent workers, representing a range of job titles at one 
facility, as independent events, and of 1-2 hours duration. The nature of instruction 
and types of learning activities were determined through observation, as well as 
curriculum materials review and interviews with developers and participants. 
Observation, participant report, and developer report indicated that for Learning 
Strategies and Easing into the Job modules, approximately 35% of instructional time 
was spent working as a whole group, 60% in small groups or pairs, and 15% working 
independently. Records from instructional session observations by the evaluator 
indicated an average of 7% of instructional time in these modules was spent in one- 
on-one instruction with participants. These breakdowns compare favorably with an 
ideal of less than 50% "teacher-talk" or whole group lecture during any one 
instructional session (Goodlad). Observations of New Directions in Customer Service 
modules indicated that approximately 90% of instructional time was spent in 
trainer(s) presenting to a whole group (including lecture method, video tapes and 
guided discussion), 0% in small groups or pairs, and 10% working independently. 
On-site interviews and observations of The Eddy/Northeast Health training sessions 
occurred six times during project operations. A sample of observation 
documentations follow on the next few pages: 
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Sample Site Visit Observation Notes 

November 18, 1996: 

10:25-11:00 a.m. 

Location : Heritage House, The Eddy- 

Content: Completion of 20 hour Tier I training, last day of class 

Participants : 3 Caucasian females, new hire CNAs 

Instructor : Dorothy Negri 

Environment : Class held in residential health care facility storage room with floor-to- 
ceiling windows with vertical blinds along one wall. Furnished with two 
tables, upholstered chairs with arm rests. Well lit with recessed 
fluorescent ceiling fixtures. Flip chart at front of room, temperature 
moderately cool. 



Time 


Instructor Activities 


Participant Activities 


10:25 a.m. 


Distributes unit pretest for Module 
4, “Knowing and Understanding 
Your Residents” 


All Ps complete unit pretest. 


10:30 a.m. 


Collects pretests. Directs Ps to 
module materials. Asks what “direct 
caregiver” means. 

Asks what quote printed on page 1 
of materials means. 


PI, P2 give individual definitions 
P3 asks for clarification of 
explanation of role 
PI -“have to experience life to know 
it. We can learn from this.” 


10:37 a.m. 


Confirms- “learn from elderly.” 

Assists Ps with locating Activity 1 
and gives directions. 


P3-“like opening a history book — I 
like to talk to them.” 

All Ps fill in activity sheet. 

P3- Asks for clarification — 
expresses difficulty in completing 
second half of exercise (visualizing 
self as an elderly resident). 

PI- Also expressed difficulty with 
this. 


10:40 a.m. 


Reviews Ps answers with them. 


All Ps debrief with own answers. 




Asks Ps to begin to think about their 
own assigned residents, where they 
have come from, what they now 
value. 
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Time 


Instructor Activities 


Participant Activities 


10:54 a.m. 


Directs Ps to Activity 2, Difficult 
Resident Behaviors. Asks Ps to 
define quotation in materials. 

Adds, “Also, we are our experiences 
from our childhood on. Experiences 
lay the foundation for building our 
personalities — influence our old age. 
Residents are the end result of all 
their experiences.” 


P2- “Children take care of parents.” 
PI- “Revert back to childlike state.” 


10:58 a.m. 


Gives Ps directions for completing 
Activity 2. States purpose of 
activity — to understand reasons for 
resident behaviors in the unit. 
Reminds Ps that discussion must 
maintain confidentiality of residents 
they serve. 


All Ps work as group, discussing 
actual residents they are working 
with in the unit. 


11:00 a.m. 


[departure from class by evaluator] 





August 1, 1996 
8:45 -10:00 a.m. 



Heritage House, The Eddy/Northeast Health 

Learning Strategies , first session of six for new hires undergoing 

certification training. 

8 Caucasian females, new hire C N A trainees just beginning certification 



Location : 

Content : 

Participants : 
training. 

Instructor : Dorothy Negri 

Environment : Class held in training room in facility. VCR and easel with flip chart at 
front. Furnished with conference room table and upholstered chairs; carpeted. 
Moderately well lit, with recessed ceiling lights. Moderate temperature. No windows. 



Time 


Instructor Activities 


Participant Activities 


8:45 a.m. 


Elicits introductions from all Ps, 
asking them to include response to 
“Why you came to become enrolled 
in C N A program here.” 


Self introductions by all Ps around 
table. 
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Time 


Instructor Activities 


Participant Activities 


8:50 a.m. 


Shows first video tape segment 


All Ps watching with intent interest. 


8:55 a.m. 


Debriefs on video, asking “What did 
you hear?” 

“Did you sense nervousness at the 
start of training?” 


[no response] 

murmurs, head nods from most Ps. 


8:57 a.m. 


Distributes activity books and 
pencils. Requests Ps to fill out 
questionnaire. 


Ps assist with distribution of 
activity books, begin filling out 
questionnaire. 


9:00 a.m. 


Collects completed questionnaires. 
Joins in Ps small talk 


Ps engage quietly in small talk 
while waiting for remaining Ps to 
complete questionnaires. 


9:10 a.m. 


Says, ‘Think about the last thing 
you learned (before new life as a C 
N A) and how you learned it.” 
Quietly distributes worksheets while 
listening. Records Ps’ responses on 
flip chart. 


Pl-“study group — for an exam.” 
P2- “course” 

P3- “how to bathe my father” 




Goes back through recorded 
responses and asks Ps how they 
learned each thing. Records 
responses. 


P4- “changing car parts” 

P5- “a new word” 

P6- “re-learning bike riding” 




Recaps learning styles used by each. 


P7- “directions to drive 
somewhere” 






P8- “new recipe” 


9:23 a.m. 


Directs Ps to turn over their 
worksheets and record which 
learning style they use most often. 






Asks them to debrief on their 
preferences. 


PI, P2, P3 give responses. 


9:25 a.m. 


shows second segment of video 


All Ps watching attentively. 
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Time 


Instructor Activities 


Participant Activities 


9:30 a.m. 


[break] 


[break] 


9:35 a.m. 


Pairs Ps and directs them to discuss 


Ps discuss among selves, working 




how they think they’ll get the most 


in pairs. [P7 writes in activity book 




from their certification training. 


by self until P8 returns from break, 
then P7 and P8 begin quick 
discussion.] 


9:39 a.m. 


“Jot your ideas down under 
‘Nurture/ Pressure’ 


P8- “I guess pressure is one of the 
elements of learning.” 




“Yes” 




9:40 a.m. 


Begins next segment of video, 


P3, P7, P8 continue writing in 




saying “Listen for the learning styles 


activity book until 9:41, then all Ps 




mentioned.” 


are watching video. 

P5, P6, P7 take notes on video 
PI takes notes in activity book. 


9:48 a.m. 


Debriefs on video segment. 

“What did you write down with your 
partner that you heard?” 


3 Ps respond with general 
murmuring of agreement. 




Reviews content of video segment, 
playing off of Ps responses. 






Asks, “Anyone feel weak in any one 
style that was mentioned?” 


P3- “Reading — remembering what 
I’ve read.” 




Gives encouraging comments, 
mentions backup systems available 
to assist with this. 


Pl-“read, but can’t pick out what’s 
important” 

P6- “same for me” 




“Perfect lead-in. We’ll discuss this 
tomorrow.” 


P8- “Problem memorizing steps. It 
makes me nervous.” 




‘Tips on the video — tricks and tips 
to memorization.” 

Asks if any questions. 

Says, “See you tomorrow. We’ll 


[no response] 
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Time 


Instructor Activities 

discuss some reading techniques like 
skimming and tips for memorizing.” 


ParticiDant Activities 

Ps nod, murmur. Begin standing up 
to prepare for next segment of their 
technical certification training. 


10:00 a.m. 


[evaluator departs] 


[evaluator departs] 



February 6, 1997 

11:20 a.m.- 12: 00 noon 

Location : Heritage House, The Eddy/Northeast Health 

Content : New Directions in Customer Service, ‘Telephone Skills” module. Pilot of 

one of seven one-hour sessions 

Participants : 8 Caucasian females, incumbent employees from this facility who use 

telephone in conjunction with job duties. 

Instructors : Gail Samuelson (Rockefeller College) and Bob Willover (The 

Eddy/Northeast Health HRD Director) as co-facilitators. 

Environment : Class held in occupational therapy room of facility. Large windows along 
one wall, with blinds. Furnished with 2 tables, and comfortable padded 
chairs. Flip chart on easel and VCR at front. Occupational therapy 
equipment sitting around walls of room. Moderately warm temperature. 



Time 


Instructor Activities 


Participant Activities 


11:20 a.m. 


Introduce each other and ask Ps to 


Ps all introduce themselves 




introduce themselves and the 
department they work in. 


individually. 




B- asks Ps what’s different from 






personal communication when 
you use the telephone. Records 


P2- “hard to interact. No body 




responses on flip chart. 


language” 




Says, “sometimes a conversation on 
the phone goes bad — due to 
anonimity — can’t be seen.” 


P6-“It’s like there’s no other 




Records response. 

‘There are other things, too.” 

“Need to realize the concerns people 
have. What we want to do is show 
video scenes to have you help us 
develop guidelines to help — then 
help you with any special concerns 
you have.” 


person.” 



ERIC 
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Time 


Instructor Activities 


Participant Activities 


1 1:25 a.m. 


Goes to VCR and introduces first 


All Ps watch VCR attentively. 




segment. 


P8-“Can I answer? Can I 




[Worker in first video segment 


answer?” (laughter by all Ps) 




doesn’t identify self to caller.] 

G records response on flip chart. 


“Worker didn’t identify self.” 






P8- “Worker didn’t give name 
and department.” 




B-“Others?” 


P5-‘The greeting” 




(G records all responses as given) 


P6-‘Tone of voice — snotty” 
P8-“Needs to be more friendly” 




B-“How can we do this?” (smiles 
broadly in exaggerated fashion)) 


P7- laughs. “Can just picture it” 
Makes a large smile, too. 




B-‘How about the number of rings? 
Is there any standard here?” 


P6-“First ring” 

P3-“first ring, by third ring” 
P6-“rings back by third ring” 




B-“We’ 11 get back to this. Let’s see 
what she learned.” 




1 1:28 a.m. 


B- Restarts video. Plays second 
segment. 


Ps [laughter] 


11:29 a.m. 


B-“Better?” Summarizes that 


PI- “Yes” 




preparing to answer during the first 
few rings is good practice. “Now 
let’s get deeper into the subject, talk 


P2- nods 




about what still could be improved.” 


P2- “could get more information, 




B- Records responses. 


like the caller’s name” 




B-“Didn’t ask questions” 


P2-“acted like trying to get rid of 
call” 




B-“Anything else?” 


Ps-no response 




G-“shouldn’t put caller on hold” 


Pl-‘That’s like you really don’t 
want to listen to what the caller 
wants.” 




B and G agree. 

B-“What can you do about hold 


P3-“take number, call back” 




situations?” 


P3-“sometimes ask, ‘may I put 
you on hold?’ then don’t wait for 


• 




answer; instead just put on hold” 
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Time 


Instructor Activities 


Participant Activities 


1 1:32 a.m. 


B-Plays third segment on VCR. 


All Ps watch attentively. 


1 1:35 a.m. 


B-“Did you catch everything? Was 
it a good transaction?” 

G-“Did everything okay?” 


Ps-no response 
Ps-nodding in agreement 


11:36 a.m. 


B-Plays VCR segment with learning 
points appearing on screen 


All Ps watch VCR 


11:38 a.m. 


B-Reviews learning points. Asks if 
there are any comments. 

B- Elicits information from Ps 
about situations they encounter 
with calls. Records their 
responses. 


Ps nod 

P7-“sometimes when six lines are 
coming in, it’s harder to be 
pleasant. 

P4- “calling back; multiple calls” 

P7, P8 have brief side discussion 
with each other about situations. 






P3-“lengthy calls” 






P2-“irate people” 




G-“What do you do to handle 
multiple incoming calls?” 
B-“phone triage” 


P5-“Say, ‘hold on’” 

P7-“try to transfer the calls to the 
right people to help them if I can” 




G-“How do you decide who to put 
on hold?” 


P2-“try to handle the calls as they 
come in.” 






P2-“depends on who is calling 
and what for. Administrator, try 
to get right through. For a nurse, I 
usually take notes.” 




B-“so you prioritize.” 


P3-“sometimes it’s the length of 
the problem.” 
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Time 


Instructor Activities 


Participant Activities 


1 1:42 a.m. 


G-“sometimes you have no choice” 


P6 to P7-“I’ve had that happen.” 
P8-“I’ve gotten multiple calls — 
and I don’t know how to use the 
“hold” function!” (laughter from 
Ps). 


1 1:43 a.m. 


G- “we need to go on. We’re dealing 
with the last scene on the video 






tape — an irate person calling. Plays 


Ps watch video tape segment. 




VCR. 


(laughter reaction during viewing) 


1 1:44 a.m. 


B-“Problems you saw?” 


Ps-more laughter 




“It can be difficult...” 


PI -“dressing badly” 




Records responses on flip chart. 


P8-“eating while talking” 
P8-“not answering the phone 
properly — there was a lot” 




B-“What else?” 


P3- “She didn’t identify herself, 






either.” 




G- “Did her irritation influence the 


P8-“She was obviously irritated.” 




results she got?” 


P5-“Yes!” 




G-“What could she have done?” 


P8, P3, P2, P7 respond. 




Records responses. 

G-“Was either caller prepared for a 


P8-“Her attitude was really bad.” 




hostile reaction?” 

G-“What can you do as the recipient 


P2-“don’t think you’re ever 
prepared for that.” 

P3, P4, P7 give similar responses. 




of nastiness to control it?” 


P8-“be nice instantly” 
P5-“Say, ‘let me help you’” 
P2-“show empathy” 




G-“What else?” 


P3-“ask for identification 
P7-“Try to find out what the need 
is” 

P8-“Get name, then use it to be on 
a personal level with the caller.” 




G-“Use name” 

G-“Has anyone taken relaxation 




training?” 


P7-“meditation” 




G- “what calms?” 
H- 


P7, P2- “breathing” 




G-“Relax, go with it” 


laughter from Ps 
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Time 


Instructor Activities 


Participant Activities 


11:48 a.m. 


B- shows video segment 5 with 
improvements. Asks Ps to look for 
improvements and ask themselves, 
“Good enough?” “More to be 
done?” 


All Ps watch VCR intently. 


1 1:50 a.m. 


B- “Any better?” 

B-“ Anything else he could have 
done? Maybe restate the problem?” 
G- Explains techniques for defusing 
callers. 


P2, P8- “He’s better. She’s not” 
Ps murmur in agreement. 
P7-“be understanding, 
empathetic” 

Ps listen 


1 1:55 a.m. 


B- [trouble finding correct spot on 
tape, rewinds, then plays 
segment 6 of video with learning 
points displayed on screen. 


Ps watch video tape segment. 




B- Asks, “Better?” 

“One more segment on tape to 
watch. Unfortunately, got a late start 
and no time today to role-play your 
situations. This last segment we’ll 
show makes the same points, 
although it’s a different location — 
about a situation in which a home 
health aide is scheduling visits.” 


P7-“a little bit better.” 
All Ps listen 


11:58 a.m. 


B- Plays segment 7 of video tape on 
VCR. 


All Ps watch; some laughter 
reactions. 




G-“What did the answerer do right?” 
G-“Other things?” 


P8-“she was really, really nice.” 
P6-“can understand caller’s 
feelings” 

P8-“handled every situation with 
patience” 

Pl-“asked questions; got 
information.” 

P7-“productive” 

P8-“put caller’s mind at rest.” 
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Time 


Instructor Activities 


Participant Activities 


12:00 noon 


G-Paraphrases and summarizes what 
Ps have said in responses. 

G-“Other things she didn’t do?” 


All Ps listen 

P5-“could have asked caller’s 
name” 


12:02 p.m. 


[evaluator departs] 


[evaluator departs] 



Participant engaged times during observations were quite high. Most participants 
appeared to want to learn, seemed to enjoy moving through the instructional units, 
and spent 90% to 95% of time in the training room actually engaged in activities and 
exercises. The program participant engaged time and interaction with trainer(s) 
compares well with engaged times of 40%-50% reported for observations of high 
school classrooms (Mikulecky). Adult learners in the Essential Skills for the Care 
Team program came to sessions ready to work and managed twice as much effort per 
hour as adolescents manage in school rooms. 




6 . 




Are the workplace literacy resources planned for use actually being used? In each 
class observed, the participants were utilizing the materials provided, and instructors 
were varying the media with which they presented instruction. The quality of 
instruction provided by the training materials has been discussed earlier in the Input 
section of this evaluation. It was, for the most part, quite high. The trainers 
established good rapport with the participants and, during delivery of Learning 
Strategies and Easing into the Job modules, took active roles in monitoring progress, 
encouraging participants, and providing explanations as necessary. Solid judgments 
of the quality of trainer explanations of concepts for these modules were observed 
during each observation. Consistency of trainer ability to explain the thought 
processes for the job-related basic skills applications was evident in presentations 
given in early stages of project operations. This coincided with the developers' intent 
for use of the customized training materials and with current state-of-the-art transfer 
of learning practices for workplace literacy, in both the military and private sectors, 
that result in highly effective application of instruction through training that refocuses 
instructional delivery practices from the teaching of memorized procedures to the 
teaching of cognitive strategies that enable skill transfer, i.e., the modeling of thought 
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processes (metacognition) used in applying skills to performance contexts. 
Observations of training later in the project did not contain evidence of this 
“cognitive modeling” instructional methodology. 



7. 




Is there a need for additional resources not initially planned for? The original 
curriculum design called for delivery via the medium of stand-up training with 
videotaped illustrative scenarios. As the project progressed, scheduling requirements 
of The Eddy/Northeast Health dictated that changes in timing and a modular approach 
be adapted. Toward the end of project operations, electronic delivery by means of 
Web TV was explored and acted upon. The PDP staff translated modules from 
Learning Strategies, Tier I Easing into the Job, and Tier II New Directions in 
Customer Service into interactive web pages that were able to be broadcast over the 
Internet in a specialized television receiver format. This adaptation added greater 
flexibility to meeting the training delivery needs of the Eddy/Northeast Health 
workforce by allowing trainees to access the Essential Skills for the Care Team 
courses in the privacy of their homes with the installation of a cost-effective receptor 
box, enabling them to use their televisions, with the addition of a remote keyboard or 
mouse, as computers. Screens were designed with interactive fields into which 
participants could enter responses, hot word links to medical terminology dictionaries 
and other resources to facilitate learning, and access to assistance at the PDP web site 
on the Internet (Please see the “Product” section of this report for more details on the 
electronic version of instruction.) The home page electronic address is 



<http// www. albany. edu. pdp/ nwlp> 



For a discussion of project process, please see "Summary of Results" under the 
Discussion section of the evaluation. Following receipt of final data in April, 1998, 
PPLC assessed program outcomes (or "product") to determine the degree of project 
effectiveness. The results are addressed in the next section. 
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Project Product : 

To what extent are there indicators of project effectiveness? 

The C.I.P.P. model enables gathering of evaluation data from more than one 
source to promote triangulation of results in an attempt to arrive at valid conclusions 
concerning project effectiveness. PPLC evaluated the Essential Skills for the Care Team 
Program from three different perspectives of users: 

• participant survey statements and structured interviews concerning 
achievement of personal learning goals and value of the course; 

• analysis of participant pre-program and post-program assessment scores; 

• review of documentation related to The Eddy/Northeast Health 

institutionalization and/or integration of Essential Skills for the Care Team 
training as a part of ,or with, existing Eddy/Northeast Health training courses; 
and, 

• review of documentation evidencing dissemination of project model and 
materials to other health care organizations, nation-wide. 

The following set of probes was used to guide interview questions, data collection 
and analyses: 

1. Are participants learning skill applications according to the workplace literacy 

program’s definition of skill need for participant performance of critical job tasks? 

2. Do program participants continue to use skill applications after they leave class? 

3. Do program participants apply new learning to performance of critical job tasks? 

4. Do program participants view the skill applications they have learned as having 

utility? 
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5. Is each participant acquiring the skill applications ter critical job tasks as 
identified in Literacy Task Analysis at their worksites? Is progress satisfactory? 
Has job performance on critical tasks improved? 

6. Can the company determine cost benefits derived from workplace literacy 
program instruction? 

1. Are participants learning skill applications according to the workplace literacy 
program's definition of skill need for participant performance of critical job tasks ? 
The first aspect of project effectiveness was determined from data collected on pre- 
and post-program surveys and from on-site interviews. It concerned the degree to 
which participants in the program were able to achieve their personal learning goals. 
During interviews on-site by the evaluator, most participants expressed satisfaction 
with the content of the Essential Skills for the Care Team training. Frequently 
mentioned was the immediate usefulness of documentation and communication skills 
on the job. When asked, "What letter grade would you give this course, and why?" 
participants rated the Essentials Program as an "A-“ course, mentioning presentation 
and materials. When the probe, "What would make this course an "A" level course?" 
was used, participants comments focused on lengthening the time for delivery and 
allowing more interaction in sessions. One group comprised of exclusively new hires 
who had had little on-the-job experience prior to their session wanted to see more role 
play activities incorporated into the training to provide them with more “job 
experiences” up front. 

The external evaluator observed participants learning such things as how to prioritize 
patient care tasks and how to maximize study success during initial job training for 
certification. These activities directly relate to the information obtained from literacy 
task analyses and from The Eddy supervisors, incumbent employees, and managers 
about critical job tasks. 



2. Do program participants continue to use skill applications after they leave class? In 
self-report appraisals of the training courses, participants completed items on the 
post-program survey that asked if the Essential Skills for the Care Team Program had 
helped them reach or work toward any of their personal goals, and if they would 
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recommend participation to a co-worker. Ninety-seven and ninety-nine percent, 
respectively, responded to each question positively. Reasons given by participants 
when asked why they would or would not recommend the course to a co-worker were 
as follows: 



Participant Comments 

-I definitely will use the information I’ve obtained through this workshop. Thanks! 

-I now feel that I am able to take notes and skim more effectively. 

-I anticipate being able to apply what I learned in this session to my job. 

-I liked the videos and listening to other aides on the videos to get input to better give me 
more understanding on how patients need to be better taken care of. 

-The activities made you think after making a statement and realizing a different outlook 
or approach and being open-minded and ready for change. 

-It has helped me identify the need to better explain myself to staff and to look at how I 
say what is heard and stress relievers. 

-With the knowledge acquired, I now have an understanding of what a CAN will learn, 
can build on it and follow up with the skills that were reviewed. 



Additionally, on January 21-22, 1998, the external evaluator conducted structured 
interviews at three Eddy/Northeast Health facilities across three shifts with 10 CNAs 
who had completed Tier I training modules, Easing into the Job (two sets of 
responses were done in pairs). The information on the following pages was given in 
response to the questions the evaluator asked: 
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1. 



How would you rate the training you received in the use of assignment sheets ? 
(Probes: On what do you base your rating ? Please give me some examples . ) 



• Good — I understood them when I got my job assignment sheets — they looked 
familiar to me. 



• I’d rate it as a “10.” The way I treat the residents, the care I can give — all 
stems from the training I received. 

• Good, no GREAT. Everything on the sheets — basic information about the 
residents, it’s all there, their specific needs, the equipment I have to use. I can 
read and understand it all very quickly. 



• It was pretty good. It helped me in finding out how to look on an assignment 
sheet and find out what to do with each individual resident and what their 
needs are. 







The assignment sheets at this facility were a little different. Now they just 
show the resident’s name; the care plan is attached to the resident’s bed. But 
the information about reading them is still okay to use. 



• The class taught me what to look for and what you need to know, especially 
the training in the abbreviations. 



• Not 100 percent. Some things it helped me with, like the medical 
abbreviations. I still found that it’s much better to get to know the person 
you’re caring for. 

• It really helped. I didn’t have any problems with it once I began working the 
job. 



• Excellent! All the abbreviations and everything really helped me. 



2. How do you know whether or not you are managing vour assignments and time 
well? (Probes : What happens if an employee doesn’t prioritize her/his tasks '? 
Please give me an example of how the staff you work with works as a team ! 




O 

ERJC 
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2 . 



How do you know whether or not you are managing vour assignments and time 
well? (Probes : What happens if an employee doesn't prioritize her/his tasks ? 
Please give me an example of how the staff vou work with works as a team .) 



• Well, there’s a time when the residents have to be in the dining room. I think 
to myself, “Who do I have to get up first, who takes longer?” I have a beeper. 
I have to keep checking time, deciding whether the task to do can be 
completed, like dressing a patient, or whether to just put on his robe. We 
really do work as a team; we all work together here on everything. I can ask 
anyone for help. We all get along. 

• The residents smile at me; nothing would go well with the residents if I didn’t 
prioritize things — giving them care, communicating with them; the teamwork 
really helps — everyday, you know you can get help with daily things if you 
get behind. 







I know everything’s okay when I’m done with work at a reasonable hour. I 
depend on my coworkers every night — for example, it takes two people to do 
a lift. Some residents are harder to work with than others; we help each other 
out with these residents. 



• When someone on the floor finishes her assignment, she helps out the whole 
group with their assignments so we all can get done at a reasonable time. If 
you get really behind, we each have partners. You pick up one or two assists 
for each other, like with making up beds and things. It works good. 

• At night, when you’re finished up everything before a certain time, you know 
you’re doing well. If after 11 p.m., you’re still not done, then yOu've been 
spending too much time with one patient or another; you have to adjust your 
time, balance things, pace yourself. If you do fall behind, your coworkers will 
help you out. We have really good teamwork. Everybody helps everybody. 

• I think I do pretty good. As a starter, it’s hard to know, but as I go on, it’s 
much easier for me. Most of the time we work as a team here; we help get 
people who are in bed up; it doesn’t matter who’s assigned to which resident. 



O 

ERIC 
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• I have a permanent assignment — I have time for everybody; I do the harder 
residents first because they are more time consuming. There really isn’t any 
teamwork in my area. 

• When I get people up in the morning, I do the easier ones first, then the more 
difficult ones. We work together as a team. 

3. How effective was the training you received concerning patient observations and 
reporting what vou see ? (Probes : What kinds of things do vou tend to report 
about residents? How much of this information is factual, rather than feelings? 
How much of this information is important detail concerning changes in 
residents’ condition? ) 



• Excellent. I know what to look for. 50% factual, 50% feelings. 







Pretty good. The resident case studies were very effective. I just know by the 
way a resident should look. With a permanent assignment, I see changes 
quickly, like blood pressure or temperatures. 



• Okay. It’s all about being sensitive to a resident’s needs. 



• I look for changes in attitudes, their skin, their appetites. I also look for any 
abnormal behavior, like being abusive to me if they’re normally nice; I report 
this or if they need some special services, like a hair cut. Once you get to 
know the residents, you see changes or problems quickly. It’s like taking care 
of your children — you know immediately if something is wrong. 

• Yes, the training was good, but the longer I’m on the floor, the more I pick up 
by myself and know what to do or report. Information I report is about 20% 
factual and about 80% feelings. Some residents are quiet at first; once you get 
talking with them, they tell you things, give you signs when something isn’t 
right. Once you get to know your residents, know more of the routine, you 
see smaller changes faster. 



• I look for things like bruises, marks on the residents that are new; sometimes 
they start to complain more than usual about a staff member or the food — 




O 

ERIC 
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that’s a sign. What I report depends on the individual. Some don’t tell you 
anything; others want you not to report things about them, but you have to do 
it anyway, if it’s something that needs to be known. Even little things can be 
very important. 

• In my residents, like I learned, I report sores, redness, bloody stool, etc. For 
example if a resident falls, I need to report how they fell, when, where, etc. 

• The training was good. This is a very stressful job; especially if you’ve never 
done this kind of thing before. I work in dementia; I have to be patient, my 
residents don’t understand; I have to think before I do anything — experience 
helps — I’m starting to understand what to look for and what little things mean. 

4. What types of things do vou do to handle potential job stress ? (Probes : What are 
some examples of things that cause stress for new hires here? If you could offer 
one piece of advice to new hires for handling job stress, what would vou tell them 
to do? ) 

• We work well here when there are 6 aides on the floor. Sometimes someone 
calls in and there are only four of us; that means more work. I use the “I’ll 
help you if you help me” routine then. It makes it easier when two CNAs 
work as a team. I’d tell a new person that you need to understand the unit, be 
friendly, and keep your own problems at home. When you work well with 
understanding the residents, you can always take major stress problems to 
your supervisor. 

• I go outside and smoke a cigarette or walk back and forth in the hall to calm 
down; sometimes I go talk to one of the residents [name omitted] — she listens 
to me. The biggest stress for me is when several residents are calling for me 
at the same time to help them; sometimes they call me names. I would tell a 
new person not to bring home problems to work, but leave them at home. I’d 
also tell them to take their time to give good care to each resident and 
recognize that you’ll be slow at first. 
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• I walk away from the problem for a while or ask for a hug from somebody I 
work with. All the alarms going off at the same time when there’s a shortage 
of staff is the worst stress. I’d tell a new employee, “If you can’t handle it, go 
get help.” 

• I smoke to relieve stress here. Sometimes you have to step away from the 
situation, you know, get away then approach it another way. Sometimes I 
walk away and count to ten, relax, then go back. The most stressful time is 
when everyone wants things at the same time — like when they all need to go 
to bed at the same time — the residents scream at you. I would tell a new CNA 
to have real good patience — if you don’t, then this isn’t the job for you. You 
need to keep a good attitude. 



• I take my break, walk some, take really deep breaths. Stress happens when 
the residents are too demanding or when they all want attention at the same 
time. I’d tell new workers to just walk away for a tew minutes and let it go; 
when you’re ready to be calm again, then go back. 



• I let it go over my head. If it’s really bad, I leave the room or report it to the 
charge nurse, then go back and finish what I was doing later. Since I’m in the 
Alzheimer’s unit, I often get someone to help me. Stress is when the 
residents’ behavior is demanding, when the belittle you and want everything 
at the same time. A new person should remember to care for the residents like 
your own mother and treat them the way you will want to be treated when 
you’re in their place. If you love them anyway, it will always be a good day 
at work. 



• I haven’t had any stress, really. It’s easier here because we all work together. 
I guess stress could happen when there are demanding people or when the 
CNAs don’t get along. I would tell the new girl, “If there are problems, talk 
to somebody, like your nursing supervisor. Discuss your problems; don’t’ 
hold it inside. 
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Think about the various types of information that are communicated on the floor . 
What are some examples of wavs in which you are involved in this 
communication ? (Probes : What should new hires do to communicate well on the 
floor? How effective was the training vou received in communication? ) 



• I report changes to the nurse that I notice; I ask other CNAs for help if I need 
it. The training was effective. 

• You ask about needs or tell what you’re going to do or are doing. The course 
preparation was okay. 

• I communicate about residents; I have to exchange information with the 
residents and also with coworkers at shift change on how the residents have 
behaved on my shift. I think the training helped me. 







Sometimes we switch assignments and have to report or ask about these 
changes. The nurse tells all of us about resident changes in a briefing before 
we go out onto the floor. The course gave us the basics in what to expect in 
communication on the floor, but on the job, it’s different from training. You 
get head knowledge the need to get on the floor and know how to handle it, 
but it’s not the real thing until you experience it. 



• We report on how the residents are doing. The training was good. 

• You tell the residents where they’re going, what you’re going to do for them 
or to them or with them; you tell the supervisor any problems that are going 
on with the residents. We had all this in class, but it was so much at once to 
learn. Once you get on the floor, it’s different — you learn more while 
working the job from the charge nurse, the supervisor, other CNAs, etc. 







I talk to the residents about their spouses or how they feel with other care 
givers on other shifts; sometimes I’ll comment that they look especially nice 
today. I also talk with the charge nurse about how the residents are doing, 
their dosages, what type of medication they’re on (different sometimes for 
different days). Sometimes I come to see the residents on my day off because 
their families don’t come. 
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was effective, but most important was the part about managing time. 
Communicating with residents and staff is different. After you get to the unit, 
you understand. 



3. Do program participants apply new learning to performance of critical job tasks? 
Using the attributes and examples from the performance indicators elicited from 
Eddy supervisors, the results of the job literacy task analyses conducted by the 
PDP staff with Eddy competent workers, and the learning objectives and 
competencies from the training modules, a structured interview form was created 
by PPLC. This form was used to ask 10 Eddy supervisors at three different 
facilities to respond to questions about their observations of task performance by 
course completers currently on the job. The purpose of this questioning was to 
determine whether or not supervisors saw evidence of applications of training in 
practice on the job. The information that follows was given in response to the 
questions the evaluator asked: 



Responses 

1. How would you rate the performance of new hires in the use of assignment sheets ? 

(Probes: On what do vou base vour rating ? Please give me some examples . ) 

• It varies by personalities — some dive in , some stand back. 

• They’re okay with that. They don’t have a whole lot of questions and appear 
to know what they’re looking for now. 

• Excellent. 

• The newer people use assignment sheets more than the old time aides who 
know the residents well. Assignment sheets are important. They have 
information for administering the care needed. 

• It’s always a big problem with assignment sheets — the care plan is a brief 
detailed description filled out by the RN. The aide looks at this to know what 
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to do. And documentation should reflect this, that is, the aide should check 
off the bed bath after it’s done; sometimes they still don’t match up at the end 
of the shift because they’re not filled out correctly. 

• We don’t use assignment sheets at night; we use a schedule. 

• I think training the new aides is effective. Every shift has a slightly different 
format for assignment sheets; lots of CNAs work different shifts and now they 
don’t seem to spend as much time asking questions about their assignment 
sheet and how to use it. 

• New hires are more apt to read and follow it now than they used to be. They 
really should, because when they’re new, they don’t know the residents. Most 
seem to get what they need just by reading it — and they all know to ask if they 
don’t understand anything. 

• They’re more aware of their assignments after this new training in how to read 
and handle their assignments, more than if they hadn’t done this training. 
They can really help people now once they’re on the unit. We teach the new 
CNAs not to handle anyone without an assignment sheet. When we get them, 
they now know what the technical terms and abbreviations mean, how to read 
important things on their sheets, like “wears ankle bracelet,” or “range of 
motion” or “one side rail up” for safety. 

2. How do you know whether or not new hires are managing their assignments 

and time well? (Probes : What happens if an employee doesn’t prioritize her/his 

tasks ? Please give me an example of how the staff vou manage with works as a 

team .) 

• They can prioritize their assignments — time management. I reinforce what 
they know when they come to me by giving them a practice scenario of being 
the new person on the unit and having to interact with the other staff members 
to prioritize the care for eight residents. 

• They know which residents get to bed early, or ask verbally. If I hear that 
they’re not doing it, I go back over the assignment sheet with them. Or if 
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everyone else is done and they’re not. Usually they work for two weeks as a 
team; it makes things like giving evening meds easier. 

• The assignment sheets are detailed for each resident. If the CNAs are using 
them, there are no problems. After a few weeks, they’re familiar with the 
routine and I can ask them to do anything. We all work together as a team the 
majority of the time. The only time anyone gets behind is in a major 
catastrophe. I help balance their work loads, trying to make sure ten residents 
aren’t scheduled to be put to bed at 7:00 o’clock. Also they work with the 
preceptor/supervisor to get help with marking their sheets to see what should 
get done first. 

• I keep an eye on them. They’re doing well if they make their rounds on time, 
get out on time, come in on time. The rounds at night are the same; mornings 
are the hectic time. I plan their assignments after the second rounds — about 
4:00 a.m. They do individual rounds; I help out with certain people or they 
work in pairs to do them together. 

• If HHAs don’t finish tasks, the RN assists them with prioritizing. Someone 
always screens the assignment sheets and time sheets; they’re instructed to 
call the office whenever they’re running late or can’t complete their 
assignments. Also, they’re supervised frequently. They receive instructions 
from other team members (RN, PA, Speech pathologist, etc.) in things like 
exercise prescriptions, physical therapy, and so on. The HHAs do this. 

• I usually start them out with the top CNA on the shift as a buddy, then they 
begin by standing back and watching. Then I assign them one resident, and 
gradually build them up to a full assignment after three weeks on the job as 
orientation. By the time the three weeks are up, I know whether they can 
work well or not. I watch the CNAs perform tasks, see that it’s working. I try 
to listen carefully to what they say, too. If somebody says, “I’ve only done 
that once before,” then I try to team them up with experienced CNAs for that 
task so they can get some guided practice and experience in it. 
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• They’re good with time management and good with team work — there’s a lot 
of transition within the unit and we all have to learn to pull together. 

• There aren’t any problems with the new hires I’ve had recently. If they’re 
able to go on break on time, ready for lunch on time, things are fine. Also, the 
regular staff will work with them or report to me if they have to, if one is 
always late or behind. 

• By observation. We have a time frame for when patients should be out of 
bed, ready for lunches. If they’re behind in the system, they can ask someone 
else to help them pick up work load. Preceptors should be watching, keeping 
up to date on what’s going on the floor. 

3. Of the new hires you supervise, what percentage of their observations are 
objective, rather than subjective ? (Probes : What kinds of things do new hires 
tend to report about residents? How much of this information is factual, rather 
than feelings? How much of this information is important detail concerning 
changes in residents’ condition? ) 

• Ninety percent factual. Individual things are reported. It depends on what has 
been retained from their training class. The on the job trainer needs to be 
observant of traits seen in the new hire — touch base with the head nurse, use 
more guidance to ward off future problems. 

• I don’t supervise. 

• My staff is good in reporting both — especially the objective. They have 
permanent assignments in our unit, so they know the residents really well. 

• Fifty percent objective. They report injuries, new bruising, skin tears, 
conbativeness, pain complaints — they always report if they’re not sure. 

• I don’t review their (HHAs) paperwork. They’re taught in training to report 
what they see, hear, smell, feel as well as the objective, factual information. 
Most times this is done. 
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• Fifty percent. In the beginning when their new, they can’t give much 
opinion — until they get to know the residents they work with. 

• They’re fairly good with that — seventy-five to eighty percent objective. 

• That depends on maturity and experience. They’re pretty accurate, most of 
them are really interested in taking care of older people and pretty perceptive. 
They notice things like bruises, especially in the dementia unit where we 
work. 

• Some of each. New hires are trained to be observant in regard to skin (bed 
sores), eating comparisons with past observations, difficulty swallowing, 
breathing, changes in motion ability, and so on. 

4. What types of things do you observe new hires you supervise doing to handle 
potential job stress ? (Probes : What are some examples of things that cause stress 
for new hires here? If you could offer one piece of advice to new hires for 
handling job stress, what would vou tell them to do? ) 

• They need proper orientation — without this, there’s stress. The preceptor 
needs to be a good role model. Working with short staff, especially on 
weekends can be very stressful. If the veteran staff isn’t helping them out, if 
they’re not working as a team with the new person and accepting them, this is 
a stressful situation for the new hire. If the new person isn’t trained properly, 
they experience lots of stress. I try to tell them to always try to identify the 
reason for their stress. Sometimes I get them to take their assignment home 
and look at it, go over it in their mind, figure out the sequence of tasks, 
become familiar with their assignment. We also have an agency program at 
the hospital that I recommend if they’re having stress outside of work. 

• A lot of the new CNAs talk out their stress with their older co workers and get 
a lot of good feedback. I tell them to ask for frequent breaks to get away from 
them [residents], especially here on the dementia unit where there can be 
personal reactions to stress. 
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• They ask to go on a break or come to the office and sit for five minutes. They 
come to me if the problem is with a patient. They know to walk away if there 
is a problem and have someone else approach the patient or go back later in 
the shift. I recommend that they sometimes have to take things to heart, put 
themselves in the resident’s shoes first. It’s not always directed at them per 
se. You need to keep communication open with the supervisor and other staff 
members. 



• Take a break; get off the floor. The residents make comments; sometimes 
they just don’t take well to new people or changes. I encourage teamwork, 
conversing with other members of staff. 



• You’d have to ask the HHA field representative about that. 



• Well, right now, I have two new hires. The bubbly one verbalizes her 
stressful situations; the quiet one, I have to watch for when she’s getting too 
quiet. As she feels more secure, I expect she’ll verbalize more then. 







I tell them to work together, support one another. I try to show by doing that 
it’s important to help out if someone falls behind, take the load off each other. 
That’s one way to minimize the job stress around here. 



• I’ve only had one problem in the past few months. One new hire was behind; 
she didn’t show stress herself on the unit, but the other aides talked to one 
another about her and I had to get them together to talk out their problems. 

• The most important thing I see them do and encourage them to do more of is 
to communicate — with the licensed staff about issues, problems, concerns. 
They don’t realize the types of behaviors they’ll encounter with dementia 
patients — these can be very stressful to CNAs. Some of us expect more than 
the new hires are ready to deliver. 



5. Think about the various types of information that are communicated on the 
floor . Now think of the best new hire vou supervise (no names, d lease) . What are 
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some examples of ways in which this new hire communicates ? (Probes : What 

should new hires do to communicate well on the floor? What percentage of the 

new hires you supervise are “good communicators” 9 ! 

• She knows the whats, whys, whos, and whens of information when she reports 
to the desk — she gives specifics, name, room number. New hires should 
provide basic information without being pumped for it — it wastes valuable 
time sometimes to get to or give the answer. 

• The biggest thing is to not just shrug information off, but to relay what they 
see. For example, if a heel is red, they should come and tell the staff person, 
even if nothing is wrong. They should take things quite seriously, ask why 
they are doing certain things today, etc. 

• Both of my new CNAs are excellent communicators. I wouldn’t improve a 
thing. 

• Be right up front. If a problem exists, tell the team leader. Use the chain of 
command first. My best CNA has done this type of work previously, so she 
has an edge. I’d say more than fifty percent of my CNAs are good 
communicators. 

• She communicates changes in client condition, safety and health hazards in a 
client’s home, any signs of physical or verbal abuse. I’d say eighty percent of 
my new hires are good communicators. 

• She gives opinions, ideas, suggestions to the RN. I don’t have any new CNAs 
right now because of recent turnover. 

• Well, she likes to vent. Seriously, she communicates well with everyone — the 
supervisor, the charge nurse, the RNs. She also can speak her mind to 
coworkers and often suggests things. She reports every little “red mark” — 
she’s extremely observant. And she doesn’t complain when she’s asked to do 
things not on her assignment. I’d guess that about sixty-five to seventy-five 
percent of them are good communicators; it just depends on the individual. 
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• She comes to the supervisor with emotional things on residents or issues with 
her peers. She gets into relationships with the residents, talks over ways to 
resolve problems with the nurse manager. About three quarters of the CNAs 
are good communicators. 

• She was very quiet in training, but she went to the intensive care unit, gained 
confidence, and now communicates extremely well. They’re all good 
communicators, they had the skills when they came onto the floor and they've 
all improved since then. 



4. Do program participants view the skill applications they have learned as having 
utility? Participants completed items on the post-program survey that asked them to 
rate the program on polarized scales for interest level, usefulness on the job, difficulty 
level, usefulness outside of work, and whether or not Essential Skills for the Care 
Team courses had been what they expected it to be. The results obtained from forms 
received indicate that all participants rated the program above average in almost every 
category. See the information displayed below for details. 



Learning Strategies: n = 65 



5= Very interesting to me 
1= Boring to me 

Averaged participant rating : 

5= Very useful to me on the job 
1= Totally useless to me on the job 
Averaged participant rating : 

5= Much too difficult for me 
1= Much too easy for me 

Averaged participant rating : 

5= Very useful to me outside of work 
1= Totally useless to me outside of work 
Averaged participant rating : 

5= Exactly what I expected 
1= Not at all what I expected 

Averaged participant rating : 



4.35 



4.33 



2.73 



3.97 



3.45 
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v 



5= Materials were excellent 
1= Materials were poor 

Averaged participant rating : 



2.57 



Easing into the Job: n = 17 

5= Very interesting to me 
1= Boring to me 

Averaged participant rating : 3.59 

5= Very useful to me on the job 
1= Totally useless to me on the job 

Averaged participant rating : 4.06 

5= Much too difficult for me 
1= Much too easy for me 

Averaged participant rating : 2.06 

5= Very useful to me outside of work 
1= Totally useless to me outside of work 

Averaged participant rating : 3.65 

5= Exactly what I expected 
1 = Not at all what I expected 

Averaged participant rating : 2.94 

5= Materials were excellent 
1= Materials were poor 

Averaged participant rating : 2.18 



New Directions in Customer Service: n = 48 

5= Very interesting to me 
1= Boring to me 

Averaged participant rating : 3.85 

5= Very useful to me on the job 
1= Totally useless to me on the job 

Averaged participant rating : 3.81 

5= Much too difficult for me 
1= Much too easy for me 
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Averaged participant rating : 2.31 

5= Very useful to me outside of work 
1= Totally useless to me outside of work 

Averaged participant rating : 3.15 

5= Exactly what I expected 
1= Not at all what I expected 

Averaged participant rating : 2.26 

5= Materials were excellent 
1= Materials were poor 

Averaged participant rating : 2.23 



4 . Is. each participant acquiring the skill applications for critical job tasks as 
identified in Literacy Task Analysis at their worksites? Is progress satisfactory? 
Has job performance on critical tasks improved? Based on participant goal 
statements and their close match with program instructional content and 
objectives, the pre-/post-assessment instrument gains provide evidence as to 
whether or not the Essential Skills for the Care Team was effective in helping 1, 
participants work toward or achieve their personal learning goals; 2, PDP program 
developers meet their training objectives; and 3, The Eddy/Northeast Health meet 
its training development goals. The assessment consisted of a set of knowledge- 
based tests of true-false, short answer completion, and matching items, used for 
both pre- and post-instruction assessment. The nine modules for which 
assessment data were received were as follows: 

• Learning Strategies 

-study skills and test-taking strategies 

• Easing into the Job -“Understanding Your Assignment Sheet” - 
-locating information, defining technical terms and abbreviations 

• Easing into the Job -“Managing Your Assignment” - 
-prioritizing multiple job tasks and time management 
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• Easing into the Job -“Knowing and Understanding Your Resident” - 
-recognizing alternate conditions through observation and 
distinguishing between objective and subjective information 

• Easing into the Job -“Handling Stress on the Floor” - 

-recognize cause/effect relationships, identify specific stress inducers, 
and techniques for dealing with stress 

• Easing into the Job -“Communicating Effectively on the Floor” - 
-speaking, listening, formulating questions, recognizing 
assertive/aggressive/passive communication styles. 

• Easing into the Job (HHA) -“Setting Priorities for Client Care” - 
-formulating goals and objectives, prioritizing by importance 

• Easing into the Job (HHA) -“Controlling Time to Complete the Care 
Plan” 

-Prioritizing by time order, time management 

• Easing into the Job (HHA) -“Dealing with the Stress of the Home 
Health Care Setting” 

-recognizing cause/effect relationships, identify specific stress 
inducers, and techniques for dealing with stress 

The chart on the next page displays compared pre-assessment and post-assessment 
scores by average percentages of correct answers. Gains were obtained in all 
categories. The average percentage of correct answers on the pre-assessments across 
all modules was 63% correct (n = 194). The average score on the post-assessments 
was 81% correct. The average gain was 18%. A complete display of scores by 
individual participant and category of assessment by module is displayed in Appendix 
A. 
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Average Gains in Percents in 
Module Assessment Scores 

</) 9 
© 

■i 5 

o 



Percent of Gain 




)% 



50 % 



100% 



■ Av. Posttest 
% correct 

HAv. Pretest 
% correct 



Module Title 

1. Learning Strategies 

2. Understanding Your Assignment 

3. Managing Your Assignment 

4. Knowing and Understanding Res. 

5. Handling Stress on the Floor 

6. Communicating Effectively 

7. HHC module 1 

8. HHC module 2 

9. HHC module 3 



PreTest % Correct 


PostTest % Correct 


73% 


87% 


56% 


76% 


70% 


80% 


75% 


92% 


45% 


64% 


60% 


87% 


74% 


89% 


45% 


63% 


73% 


95% 



6. Can the company determine cost benefits derived from workplace literacy 
program instruction? The Eddy/Northeast Health Vice President for Human 
Relations has stated that she will e examining existing company records over in 
the months following project operations to identify areas in which this program 
has had any impact on reducing costs or saving the organization money. Areas to 
be investigated include performance improvement, training costs, and turn-over 
rates among new hires, which was given as one of the primary reasons for 
entering into the project with PDP. CNAs suggested in interviews that reasons for 
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their colleagues leaving The Eddy/Northeast Health are usually to obtain even 
marginally higher wages at one of the other area health care facilities, rather than 
because of issues over working conditions, training, or job stress. The Vice 
President noted, however, that because this population (CNAs and HHAs) are 
often subject to stressful lifestyles that cause them to rapidly depart from the job 
without giving notice, participating in an exit interview or even leaving a 
forwarding address for receipt of their final paycheck, it is difficult to determine 
reasons for leaving or persisting in the job. Overall, top management 
representatives reported (in a regional symposium conducted in November, 1997) 
that they are pleased with the results and plan to continue using the training 
modules developed during project operations as part of their regular ongoing 
training activities — with or without having the outcomes of cost benefit analyses 
available. This, coupled with the joint effort for development of New Directions 
in Customer Service targeted to enhance action toward support of the new 
organizational mission statement following their merger process, seems to 
indicate that the program products will be institutionalized. 

Dissemination of Project Model and Training Program - In a copy of an interim 
reports to the U.S. Department submitted by the Project Director throughout the duration 
of project operations, information was provided evidencing dissemination. The project 
training materials and delivery guidelines were made available to the ERIC system and 
attendees at numerous conferences throughout the nation. The Eddy and PDP jointly 
presented the program and training materials at the Annual Conference of the New York 
Association for Continuing and Community Education in April of 1995, the Adult 
Learning Center in Albany, New York in June of 1995 and September of 1996, a staff 
development session for adult educators in Portland, Maine in August of 1996, the NY 
BOCES in September of 1996, and at the National Workforce Education Conference, 
Milwaukee, Wisconsin, in November of 1996 and 1997. Additionally, the program 
design and achievements were highlighted in articles published in the The Eddy News, 
(Spring, 1995, pg. 1, and 1996, pg. 5), and in The University at Albany Update, (Volume 
19, No. 23, April 24, 1996, pg. 3). Analysis of these materials indicated that the project 
had, in fact, created a replicable, functionally contextual model for workplace literacy 
instruction in the health care field. 



Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, W (304) 343-6861 FAX (304) 342-4996 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



87 



Two additional, highly innovative dissemination activities occurred during the 
project: a regional symposium for health care organizations conducted at The 
Eddy/Northeast Health facility in Troy, New York on November 13, 1997, and the 
posting of modules for Home Health Care Aides on the PDP home page on the Internet. 
Both of these activities enabled the project partners to widely disseminate their program 
materials, model, philosophy and project results. 

The one-day Symposium, Workplace Education in the Healthcare Environment: 
the Why, the What, and the How, included welcoming remarks by Craig Duncan, 
President and CEO of Northeast Health, who spoke of the rapid changes occurring in the 
healthcare industry. Jo- Ann Costantino, Executive Vice President and CEO for the Eddy, 
also provided opening remarks in which she commented on the successful outcomes of 
the Eddy/Northeast Health workplace literacy national demonstration project, noting 
employer and employee satisfaction with the results. Larry Mikulecky, a national 
academic in workplace literacy research gave the Keynote address, “Workplace Literacy 
Education: Why Should Employers and Employees Invest?”, followed by two panels of 
health care workplace literacy project representatives. These included Wilma Sheffer and 
Loma Finch from St. Louis Missouri Community College; Barabra McCandless and 
Christine Katchmar from The Eddy and PDP; Claude Grant, Doris Dingle, and Natalie 
Hannon, from the Bronx Community College; Harvey Huth and Harriet Spector from the 
Civil Service Employees Union and the [NY] Governor’s Office for Employee Relations, 
Division of Developmental Services; Lorry Villemaire, and Dorothy Seidel from the 
Holyoke, Massachusetts Geriatric Authority Resource Center; and Christine Archambault 
from the Bronx Co-Op. The panelists presented their programs to approximately 50 
invitees from the northeast states. The topic the morning panelists’ presentations 
addressed was “Addressing Critical Issues in Educating Direct Care Workers.” The 
afternoon panelists’ presentations focused on the topic of “How to Implement Workplace 
Literacy Programs in the Healthcare Environment: Alternative Approaches.” Each panel 
was followed by two reactors: in the morning, Francine Boren Gilkenson, Director of 
Special Projects for the 1199 Hospital League training and William Ebenstein, Director 
of the CUNY Consortium for the Study of Disabilities; in the afternoon, Robert Knower, 
Workplace Literacy Coordinator in the Office of Workforce Preparation and Continuing 
Education at the NY State Education Department, and Jorie W. Philippi, a national 
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researcher and developer in the field of workplace literacy. The Summary Address, “A 
Federal Perspective,” was given by James Parker, the Workforce Education Coordinator 
for the US Department of Education, Washington, DC. 

The PDP home page on the Internet also provides a unique method for project 
dissemination activities. It includes a description of the project, the US Department of 
Education outlook for the future of workplace literacy, an executive summary of the 
Symposium (with links to download the entire published papers from the Symposium), 
descriptions of all project curricula (with links for downloading files containing the 
curricula), and a demonstration of the translation of modules for Web TV. 

The translation of the Home Health Care Modules to electronic instruction, that 
was posted to the PDP home page on the Internet and able to be accessed by HHA 
Eddy/Northeast Health trainees and anyone else interested in the program products, was 
completed during the project four month no-cost extension, from January through April, 
1998 — primarily through the efforts of Eugene Monaco, Dorothy Negri, and PDP 
technical support staff. These sessions are interactive and allow participants to access 
training from their own homes with the attachment of a special receiving box to their 
home telephones and televisions. Operating much like a local area network for 
computers, the server transmits the modules over the Internet, via the medium of Web 
TV. The cost of a remote keyboard or mouse and receiver box is less than $300 per 
system. This is more cost effective than purchasing multi-media computer systems for 
individual learners to use at an estimated cost of $1500-2000. The Eddy/Northeast 
Health plans to purchase additional Web TV access systems to provide flexible 
delivery — either in trainee’s homes or at any hour at training facilities. 

Contents of the instruction posted on the PDP home page of the Internet for 
access through Web TV included the following: 

• An introductory screen linking the user to six areas or back to the PDP 
web-site; 
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• A lesson about learning styles that introduces the two “learner” 
characters and the “mentor” character illustrations and functions, 
presents a variety of learning styles along with an interactive quiz (17 
screens plus linkages) 

• A lesson on the topic of understanding the assignment sheet that 
introduces the concept of medical terminology and abbreviations 
occurring on these sheets, plus the availability of the electronic 
glossary; it contains an interactive quiz and two practice exercises (17 
screens plus linkages) 

• A lesson that provides practice with medical terminology 
abbreviations in the form of two “jeopardy” games with electronic 
scoring (6 screens plus linkages) 

• A lesson on dealing with caseloads, including patient reactions and 
typical interference with tasks; presented as instruction and two 
interactive quizzes, one in multiple choice format and one in matching 
format. (11 screens plus linkages) 

• A lesson on dealing with caseloads, emphasizing methods for 
prioritizing tasks, and including two interactive quizzes (25 screens 
plus linkages) 

• A glossary of medical terminology and abbreviations. 

Results of a survey administered during the pilot to thirteen experienced CNAs or 
LPNs with varied levels of computer expertise, indicated the following: 

• Lesson objectives were clear 

-76.9% agree 
-23.1% strongly agree 



Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 



The Eddy/Northeast Health and Rockefeller College, University at Albany 
Essential Skills for the Care Team External Evaluation: FINAL REPORT 



90 



• Web TV site was simple to operate 

-53.8% agree 
-23.1% strongly agree 

• Lessons were interesting and effective 

-53.8% agree 
-30.8% strongly agree 

• Felt like an active participant in the learning process 

-61.5% agree 
-23.1% strongly agree 

• Lessons compared favorably to classroom training 

-38.5% agree 
-23.1% strongly agree 

• Would take another Web TV course 

-38.5% agree 
-38.5% strongly agree 

• Lessons were overall of a high quality 

-38.5% agree 
-23.1% strongly agree 

• What were the best features of the lessons? 

-Lesson number 3 for the abbreviation skills, and also lesson 
number 4 on caseload. 

-I would rather see it on TV than read it in a book 

-The lessons were placed at a very simple level 

-Interesting pictures and clear terms 

-I prefer hands on 

-The glossary for the abbreviations 

-The questions were good 
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-User friendly quizzes 
-Not feeling rushed 

-Learning how to use a computer and having everything you want 
to know at the touch of your fingers. The best is the abbreviation 
part — it shows you what they mean for anybody who doesn’t 
understand something. When you tell them, they can see what it 
means. 

-Fun to learn 

-The lesson was easy to understand, simple, and to the point. 

A focus group conducted after the pilot came to the following conclusions: 

• More time should be spent up-front to lead trainees through basic 
operations of Web TV and its integration with instruction. 

• Content was correct, readable, and informative. 

• Even division of preference for Web TV versus stand-up training 
delivery formats. Most preferred partners to learn with 

• Experience was “fun.” 



For a discussion of program product, or outcomes, please see "Summary of 
Results" under the Discussion section of the evaluation report, which begins on the next 
page. 
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Discussion 



Limitations of this study - There were two factors that acted as limitations on the ability 
of this study to draw definitive conclusions from the evaluation. The first factor was the 
difficulty experienced by the evaluation in collecting and obtaining some of the requested 
data from some of the program partners in the formats required for inclusion in the 
evaluation. The conduction of data collection from a distant location for the majority of 
the demonstration period placed excessive responsibilities on an already over-burdened 
local project staff. Although the staff in this project exhibited an exceptionally 
cooperative attitude, the unavoidable off-site monitoring functioned as a somewhat 
limiting factor in this evaluation in that there was a minimum of direction and no training 
available in using the various data collection instruments that were developed. The 
second, related factor was that influences external to the project resulted in high turnover 
among key project personnel, including three project directors — one of which served for 
less than one month — ongoing changes in curriculum developers, instructors, and office 
assistants. This caused project development, delivery, and record-keeping processes to 
vary with personnel; this impacted on the continuity of project activities, products, and 
data collection. 



Summary of Results - The following statements provide summary and discussion of key 
findings from the evaluation of project context, input, process, and product. 

Context - The extent to which the goals and philosophy of the project were shared by key 
project personnel and participants was found to be as follows: 

Areas of convergence : There was a good deal of consensus about program goals 
among the Project Directors, the curriculum developers, The Eddy upper level 
management, Eddy/Northeast Health supervisors, and The Eddy training staff. All 
highlighted the importance of providing training in prioritizing, communication, 
problem-solving and decision-making skills for CNAs, HHAs, and other ancillary health 
care team workers, and saw the Essential Skills for the Care Team program as a means 
for enabling mastery of workplace applications of basic skills embedded in the context of 
competent performance of direct and related health care giver job tasks. Supervisors 
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identified performance indicators, i.e., specific observable behaviors for the areas of job 
performance addressed by the program, also correlated with training objectives for 
prioritizing, communication, and problem-solving/decision-making modules of the 
program. Participants also commented on their desire to improve these skills and on the 
program's relevance to accomplishing their personal goals. 

Areas of divergence : The main areas of divergence were evidenced during 

comparisons of interview responses from PDP initial project staff with those of later PDP 
personnel. During the second half of project operations, PDP curriculum developers and 
instructors appeared to be less clear as to the original workplace literacy developmental 
philosophy which had served as the rationale and basis for the Essential Skills for the 
Care Team. Along with key project personnel from The Eddy/Northeast Health training 
department, they expressed opinions that the program would serve as a vehicle for 
providing instruction in soft skills that supported the customer service aspects of the 
mission statement of the newly merged organization. As a formative evaluation finding, 
this pointed to the need for more structured training of PDP and Eddy/Northeast Health 
staff who were new to this project in order to sustain the original program vision and 
maintain continuity of objectives. 

These observations should not be taken to mean that key personnel from either of 
the partnering organizations were in any way responding negatively toward the Essential 
Skills for the Care Team program. Their dedication to seeing the program through to 
successful completion and energetic efforts to produce high quality training programs 
were both innovative and effective, despite the blurring of instructional objectives and 
shift in emphases of content during the life of the project. 

It is likely that the refocused courses which were developed will be more readily 
integrated into the ongoing training program of The Eddy/Northeast Health than if they 
had been exclusively targeted at improving workplace literacy skills. 

Input : The availability to the project of resources during development and 

implementation and to what extent they were effectively used was found to be as follows: 
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Strengths and Weaknesses - The curriculum materials developed for the program 
were built from numerous contextual examples of skill applications that CNAs, HHAs, 
trainees and incumbent ancillary employees must use in the performance of critical job 
tasks. This curriculum enabled participants to practice skills in ways they will use them 
on the job. Resources for program development appeared to be adequate financially for 
the development, publication, and delivery of instruction. Material development time 
lines and on-going revisions based on Eddy/Northeast Health input and feedback that 
were incorporated across the delivery time lines for program activities might have 
impacted much more greatly on the stress levels of less experienced developers. Despite 
an “evolving” curriculum development team and coordination across agencies and 
facilities with a video consultant, deadlines were met and almost 1500 trainees and 
employees received instruction. 

Desk-top publishing the materials did not present a problem for the developers, 
nor did production of the accompanying videotaped segments. Working in conjunction 
with the Eddy/Northeast Health training staff, PDP developers were able to script video 
footage suitable for use in training session situational examples. Due to the short 
duration of time for instruction in any one module, testing time was at a premium. The 
use of the same tests as both a pre- and post-assessment instruments for many modules 
provided a tool for measuring what was learned during the program and the degree of 
individual mastery of concepts presented; .however, using identical, rather than parallel 
instruments eliminated controlling for memory variables in the short period of time 
between measurements. Those modules that used self-assessment offered less objective 
measures of gains. Participant responses on self- appraisal scales often indicated the lack 
of commonly held and understood standards against which all participants were asked to 
measure their performance. 

Content of the program curriculum was well designed, including the modeling of 
thought processes in those modules developed during the first half of the project. The 
resulting original materials created for the project contain strong lessons that offer 
participants opportunities to develop cognitive awareness of their thinking strategies 
during the application of basic skills to job tasks, and that enhance the probability of 
continued application of those skills learned. The scripted instructional guidelines for all 
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modules eliminated any confusion or variations in content delivery or instructional 
quality and greatly facilitated the turning over of the program to Eddy/Northeast Health 
trainers for future delivery. 

Program developer qualifications and previous experience were rich and highly 
professional; they provided a definite enhancement to the program overall. The ability of 
the Project Directors and the Eddy/Northeast Health Human Relations Vice President and 
their staffs to weather and overcome turnover and changes in organizational structure that 
were beyond their control, demonstrated strong commitment of the partners to program 
success and a keen awareness of the teamwork required to obtain it. Regular planning 
committee meeting attendance throughout the project underscored this high level of 
commitment to the project by the partners. 

The omission of formal train-the-trainer sessions for PDP staff and Eddy 
Northeast Health trainers during program operations proved to be problematic; it 
hindered program continuity and may influence program replication that will remain true 
to the program's original goals and philosophical under-pinnings. On the other hand, 
careful attention given to the Eddy training content and culture at the onset of the project, 
and constant feedback from The Eddy facilitated the "good fit" of the Essential Skills for 
the Care Team program into the existing Eddy/Northeast Health training system. 

Process : The extent to which program operations, development, and observed instruction 
were congruent with program goals and research on instructional effectiveness follows: 

Areas of convergence and divergence - Participant engaged time was quite high 
and observed CNA and HHA participants spent 90%-95% of time in the training room 
actually participating in skill building activities. Both trainers and participants appeared 
motivated to take full benefit of training time and took pride in the efforts made. An 
example of this was evidenced during several delivery session observations, in which 
participants and instructors alike seemed reluctant to end the session, despite rigid time 
constraints. Numerous comments on participant post-surveys also indicated trainee and 
employee desire for additional time to spend in training courses such as these. 
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The quality of instruction was good overall. All of the developers and the 
Eddy/Northeast Health trainers, who were observed while delivered program sessions, 
appeared to be engaged in "reciprocal learning" with the participants and displayed a 
caring attitude and willingness to assist participants achieve their goals. An ability to 
demonstrate the thinking processes necessary for transferable basic skills to be taught 
contextually in an effective manner was evidenced in some, but not all instructional 
delivery. 



Project management, selection and recruitment of participants, and so on, were 
well administered and appeared to be effective, with numbers of participants matching 
projected levels, despite lengthy start-up periods for each level of instruction that was 
developed. Normal tension with facility and agency supervisors over release of 
employees to attend sessions appears to have been dealt with as it arose and kept to a 
minimum. Participant comments about what they expected to learn and what they 
actually learned were good indications that, after the program design and contents were 
determined, program advertisement and publicity accurately reflected content. 



Regularly scheduled meetings between the PDP and The Eddy/Northeast Health 
and active participation in these meetings by representatives of the partners demonstrated 
a high level of commitment and ability to work as a team. Topics addressed in the 
meetings allowed all partners to be kept up to date on project activities and progress and 
to give input into the decision-making process as options arose and were explored. Based 
on the minutes of these meetings, issues appear to have been addressed, discussed, 
investigated, and resolved as they were put on the table. 



The number of pilot sessions was adequate and revisions based on feedback from 
these sessions were made in a timely manner. In so doing, the developers were able to 
create training programs that met the needs of The Eddy/Northeast Health so that they 
were able to be readily incorporated into the existing organizational pre-hire, new hire, 
and incumbent employee training courses. This indicates success of the project in 
developing a program that can be easily replicated by or incorporated into health care 
training systems throughout the country. 
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Product : The impact of the program was assessed with a combination of indicators, 
including comments gathered from participants, comparison of pre- and post-assessment 
scores, interviews with supervisors/managers, and evidence of dissemination. A 
summary of the results follows. 

Business and industry organizations normally evaluate training on four levels. 
Because workplace literacy programs are directly related to assisting workers attain 
career goals by meeting job requirements and improving performance on job tasks, it is 
appropriate to measure program outcomes using this yardstick: 

Level 1 - Does the proposed program match with an identified organizational need? In 
this case, the front-end analysis conducted by PDP identified organizational needs for 
improved CNA, HHA, and ancillary care workers workplace basic skills applications. 
Comparison of the objectives and contents of the Essential Skills for the Care Team 
training materials with these front-end literacy task analyses show that specific critical 
job tasks were identified and targeted. During development of Tier II materials, New 
Directions in Customer Service , the partnering organizations worked as a team to 
produce materials that continued to match closely with the organizational mission 
statement and training goals, despite organizational restructuring. 

Level II - Do the participants selected for training master the content of the training 
program? Impressive gains from pre-/post-assessment scores, and post-program 
statements by participants, compared to pre-program goal statements, provide strong 
evidence that participants mastered the content of the Essential Skills for the Care Team 
program on all three levels. Post-program survey open-ended response items provided 
extensive evidence that participant goals had been worked toward or met, and that these 
goals coincided with the objectives of the training program. Gains on the assessment 
instrument also demonstrated training mastery. For data analysis purposes, the average 
percent of correct responses was calculated from individual raw score data. This enabled 
comparison of module gains by percentage of gains, without consideration for the 
number of items in each module. That there are short ranges of values for the average, 
median and mode, and total score in both the pre-assessment or post-assessment results 
(for those modules selected for more extensive analyses procedures) indicates that the 
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assessment instruments are not skewed by one or two high or low scores. That gains 
were consistent in each category of assessment and for each of the modules provides an 
indication of the appropriateness of item design for discrimination. To further determine 
item difficulty and discrimination capabilities, and memory interference variables, a 
detailed analysis of response errors would need to be conducted. 

The average percentage of gain was 18%. When compared to gains on 
standardized academic basic skills tests, this is comparable to a gain of two stanines, 
usually equated with two grade levels of improvement, within just forty (cumulative) 
hours of instruction. Research on the transfer of learning and on basic skills suggests that 
the reason for this might be use of the functionally contextual approach: 1, the closer the 
training task matches with the desired performance outcome, the more likely it is that 
positive transfer of learning will occur (Gick and Holyoak); and, 2, even a small amount 
of previous experience and knowledge base for the context to which the skills will apply, 
enables the learner to activate schema and raises the difficulty level of materials that can 
be comprehended by approximately 1-1.5 reading grade levels above that which would 
be achieved on a standardized reading test. (A complete display of assessment data can 
be seen in Appendix A.). 

Level III - Do those participants who master training demonstrate improved job 
performance in areas identified as critical, to show positive transfer of learning ? 
Comments elicited from participants indicate that their perception of their personal 
learning was that it would directly impact on their job performance. The ability to 
transfer learning from training to performance is most dependent on the trainee's ability 
to identify performance situations to which he or she will apply the newly acquired skills, 
along with opportunities to use the new skills and the motivation to do so (Bramley). 
Again, the use of a functionally contextual approach facilitates recognition of situations 
in which new skills can be applied to performance. 

The supervisors of CNAs and HHAs identified performance indicators and 
observable behaviors for measuring training transfer and program impact. Unfortunately, 
geographical distances and inadequate communication and leverage resulted in lack of 
completion and use of these data collection tools by the supervisors of the participants. 
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The indicators elicited do serve, however, as evidence that the tasks and skill 
competencies contained in the training correspond with the performance values of 
supervisors. That the participant scores demonstrate their mastery of the applied basic 
skill competencies they need to perform competently in their jobs, and that supervisors 
value these skills, provides an indication that, with motivation and opportunity to use 
their new skills, CNAs and HHAs will, in fact, transfer what they have learned to their 
job performance. 

Level IV - Does impact on performance lead to demonstrable cost benefits , i. e . , money 
saved or generated by the positive change in employee behavior? In this case, The 
Eddy/Northeast Health did not report indications of positive program impact via 
individual behavioral indicators, performance appraisals, or supervisor ratings before and 
after training participation; nor did they cross-reference these with the instructional 
objectives of the program. No data exists, therefore, for determining the possible cost 
benefits derived from employee participation in the program. During structured 
interview sessions with upper level management, various indicators of improved job 
behaviors that would result in fewer customer and care problems and greater longevity of 
workers were identified. These could be studied with a control group design to determine 
possible cost benefits from the training program, both immediately following training and 
at three month intervals thereafter, to determine the amount of long-term gains and their 
retention. 

When programs are underwritten by federal funding, it is viewed in a positive 
way to apply such monies to value-added training for an organization's workers. When 
an organization does not elect to invest in continued human resource development, (i.e., 
the program), at this level of commitment beyond the funding period, it indicates that 
such training has not become an organizational priority. In discussions held by the 
evaluator with representatives from The Eddy/Northeast Health near the conclusion of 
the project, the decision to institutionalize the demonstration project training modules 
was viewed as highly likely. This is strong evidence that the program is perceived to be 
one that adds value to The Eddy/Northeast Health. 
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If The Eddy/Northeast Health is to continue offering Essential Skills for the Care 
Team modules as a part of its core training for CNAs, HHAs and incumbent ancillary 
workers, the tasks and materials will need to be updated periodically to ensure that they 
remain valid contextual examples of actual workplace situations and requirements. The 
process and design pattern for curriculum development set out by PDP in its model of 
functionally contextual instruction provides a proven prototype that could be replicated 
for development of additional exercises. The training and use of in-house or external 
instructors to support delivery, or self-instruction of Essential Skills for the Care Team in 
the future is wholly dependent upon the staffing needs of The Eddy/Northeast Health; but 
the well-developed, structured, published instructor guidelines, videotape vignettes, and 
Web TV access for the modules ensure the flexibility of future delivery options. 
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Conclusions and Recommendations 

Based on the results of this evaluation, the following conclusions and 
recommendations concerning stated grant goals are offered. 

There is strong evidence showing: 

• that a workplace literacy program model for eldercare workers has been 
developed and demonstrated that is both effective for the specific context of 
the project, and transportable across the industry, including instructional 
design and materials, through: 

-conducting a thorough workplace literacy task analysis of all targeted 
job categories across The Eddy and its network of affiliates; 

-producing a 40-hour two-tiered curriculum in workplace literacy skills 
for Certified Nursing Assistants, Home Health Care Aides, and 
ancillary staff of the care plan team, the housekeeping and custodial 
workers, and the food service staff, that addresses the results of the task 
analyses and that will be partially video-based; 

-delivering the 20-hour, Tier I curriculum over the three-year period of 
funding to all new hires in the targeted job categories across the 
network of affiliates (approximately 750 employees); 

-delivery of the 20-hour, Tier II curriculum over the third year of 
funding to all veteran staff, including those who received the Tier I 
instruction in the first and second years of funding (approximately 840 
employees); 

-tailoring the existing 4-hour Learning Strategies module to the Nurse 
Aide and Home Health Care Aide new hire population to prepare them 
for their initial job training, and to deliver this module to all the new 
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hires during the course of the three year period of funding through a 
video-based module; 

-developing a 4-hour orientation and instruction program for supervisors 
of the targeted workers; 

-producing, through an outside evaluator, an analysis of the overall 
effectiveness of the proposed program with respect to immediate target 
population and the industry within which it is implemented; and, 

-making the curriculum design and materials available to the adult 
literacy field and the eldercare industry through conference 
presentations, professional gatherings, and various publications. 



There is a moderate amount of evidence indicating: 

• that literacy gains were produced among members of the Care Plan Team of 
The Eddy and its network of affiliates — the Certified Nursing Aides, the 
Home Health Care Aides, and the ancillary housekeeping, custodial, and food 
service staffs — in order to enable the aides to complete the initial job training, 
and to enable all staff to perform literacy-related job tasks more effectively to 
increase job productivity, through: 

-developing and administering a workplace literacy skills assessment 
that will inform instruction and be used as the basis for Individual 
Education Plans; and, 

-developing and periodically administering workplace literacy 
assessment and evaluation measures that yield quantitative data to 
examine the effects of instruction. 

There is little or no evidence indicating: 
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• that a process was designed for the development and implementation of the 
Individualized Education Plan for each new hire, that incorporates a role for 
The Eddy’s human resource and training functions; and 

• that the capacity to provide ongoing support to the targeted workers after 
their initial training was developed through the supervisory staff of the 
targeted categories of workers, through The Eddy’s human resource 
counseling function, through the Literacy Volunteers of America of New 
York State local affiliates, through the establishment of learning resource 
centers within the physical plant of and its network affiliates, and through a 
peer “buddy” system. 



Recommendations : 

1. Identify individual activities or responses that directly correlate with each 
learning objective or competency for each module. Use these to create 
performance-based or written items to develop parallel versions of a testing 
instrument to measure levels of skill attainment resulting from training. 

2. Develop performance indicators, from supervisor input, for each critical job 
task addressed by the training modules. Use these indicators to benchmark 
pre-training levels of performance and to measure post-training levels of 
performance of participants. Use this information to determine the amount of 
impact of training on job performance and to set performance standards for 
appraisals. Also use this information to modify course content, as needed, and 
to determine team, department, and/or facility/agency future training needs. 
Also use this information 

3. Conduct extensive literacy task analyses on job tasks other than CNAs and 
HHAs. Use the results to revise and update Tier II modules in order to 
incorporate cognitive, or human information processing, skill objectives into 
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instruction that will enhance the transfer of training to job performance for 
participants. 

4. As an organization, revisit the project goals and objectives for utilizing 
individual education plans and learning support structures (e.g., LVA-NY, 
learning resource centers, HR counseling) for employees who participate in 
training. These may prove useful as training restructures to include the use of 
multiple delivery formats, some of which, (e.g., Web TV), may be off-site. 



Concluding Statement : After working with this project for over 3 years, it is the opinion 
of this evaluator that this has been one of the better U.S Department of Education 
Workplace Literacy demonstration projects funded to date. This conclusion is based on 
abundant evidence showing: 1.), the vast amount of high quality, customized 

functionally contextual training materials that the PDP staff produced throughout the 
demonstration period; 2.), the ability of the Project Directors and The Eddy/No rtheast 
Health Human Resources Vice President and training staff to accomplish project tasks 
and solve unforeseen problems through tenacity, innovation, unflagging high energy 
levels, and constant attention to detail; and, 3.), the pending institutionalization and 
ongoing enthusiastic support for the project by its organizational partner. These 
ingredients indicate success. 
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Appendix A: 



Pre- and Post-Assessment Data 
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Learning Strategies Self-Assessment 



A-1 



Self Assessment content: 

1 . On the following scale, rate yourself as a learner. 

1 - I lack self confidence as a learner 

5-1 have a strong sense of myself as a competent learner. 

2. On the following scale, rate your readiness for this training. 

1 -I am not sure if I am ready for this training. 

5-1 am confident that I am fully prepared for this training. 

3. On the following scale, rate your ability to take notes when someone is giving a lecture. 

1 -I do not have ideas for taking effective notes during a lecture. 

5-1 know how to take notes effectively during a lecture. 

4. On the following scale, rate your ability to skim material before you read it. 

1 -I am unsire of the way to skim material before I read it to get the big picture. 

5-1 know the way to skim material before I read it to get the big picture. 

5. On the following scale, rate your ability to highlight key information on written materials 
while listening to an instructor. 

1-1 am unsure what to highlight to help me remember key information. 

5-1 know what to highlight to help me remember key information. 

6. On the following scale, rate your understanding of closed and open questions. 

1 -I am not sure how and why to ask closed or open questions. 

5-1 understand how and why to ask closed or open questions. 

7. On the following scale, rate your knowledge of effective test taking strategies. 

1 -I do not know effective strategies to use for taking tests. 

5-1 know effective strategies to use for taking tests. 

8. On the following scale, rate your knowledge of effective strategies to reduce test anxiety. 

1 -I do not know how to reduce test anxiety. 

5-1 know effective strategies to use to reduce test anxiety. 

Comments by learners: 

I was intimidated -the first day even though I have known other people who have taken this course. 

I feel much more confident and I'm very anxious about completion of the course. 

I am better than I thougth I was.l 

My understanding and knowledge of matters were better than I had before this course. 

I now feel that I am able to take notes and skim more effectively. 

I definitely will use the information I've obtained through this workshop. Thanks! 

I am doing better than before this program. 

I learned a lot but I think I can learn more. 

PLEASE NOTE: The data displayed on pages A-2 through A-1 5 represent the self-assessments of participants 
indicated by the numbers in the top row (n=213). Average, median, and mode are displayed on page A-1 5. 
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Learning Strategies Self-Assessment 



A-2 
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Self rating as a learner 


4 


4 


5 


3 


5 


5 


1 


4 


5 


5 


5 


4 


4 


5 


Readiness for training 


3 


4 


5 


4 


5 


5 


4 


4 


5 


5 


5 


4 


5 


5 


Ability to take lecture notes 


3 


4 


4 


3 


5 


3 


4 


3 


5 


5 


5 


5 


4 


5 


Skimming material before reading 


4 


4 


4 


3 


4 


3 


3 


3 


5 


5 


5 


4 


5 


5 


Highlighting key information 


5 


4 


4 


4 


4 


3 


3 


4 


5 


4 


5 


4 


5 


5 


Understanding of open/closed questions 


2 


5 


4 


1 


5 


1 


3 


3 


4 


5 


5 


5 


5 


5 


Knowledge of test-taking strategies 


3 


4 


3 


3 


5 


2 


1 


4 


5 


5 


5 


5 


4 


5' 


Strategies for reducing test anxiety 


3 


4 


4 


4 


4 


3 


1 


4 


5 


5 


5 


5 


4 


5 
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A-10 




PRE SELF-ASSESSMENT 


141 


142 


143 


144 


145 


146 


147 


148 


149 


150 


151 


152 


153 


154 
































Self rating as a learner 


4 


3 


5 


3 


4 


4 


4 


4 


3 


3 


2 


4 


3 


4 


Readiness for training 


4 


5 


5 


5 


5 


5 


5 


5 


4 


4 


3 


5 


5 


3 


Ability to take lecture notes 


3 


3 


5 


3 


4 


5 


4 


3 


3 


4 


4 


5 


5 


3 


Skimming material before reading 


3 


3 


2 


3 


5 


5 


4 


3 


2 


3 


4 


4 


5 


4 


Highlighting key information 


3 


5 


4 


5 


4 


4 


4 


4 


4 


4 


3 


4 


5 


4 


Understanding of open/closed questions 


4 


4 


2 


3 


5 


5 


3 


4 


2 


4 


3 


2 


4 


4 


Knowledge of test-taking strategies 


3 


4 


3 


3 


4 


4 


4 


4 


4 


3 


4 


3 


3 


2 


Strategies for reducing test anxiety 


3 


5 


3 


2 


3 


4 


3 


4 


2 


4 


1 


2 


2 


3 
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Self rating as a learner 


5 


4 


5 


3 


4 


5 


4 


4 


4 


5 


4 


3 


4 


3 


Readiness for training 


4 


5 


5 


3 


3 


4 


5 


4 


5 


5 


4 


4 


3 


3 


Ability to take lecture notes 


5 


5 


5 


3 


4 


5 


4 


3 


3 


4 


3 


3 


4 


4 


Skimming material before reading 


4 


5 


5 


3 


4 


5 


5 


3 


2 


4 


3 


. 2 


4 


5 


Highlighting key information 


5 


4 


5 


3 


4 


5 


5 


4 


4 


5 


3 


4 


4 


4 


Understanding of open/closed questions 


5 


5 


5 


3 


4 


5 


4 


3 


2 


5 


5 


3 


3 


5 


Knowledge of test-taking strategies 


4 


4 


5 


3 


3 


5 


4 


3 


3 


5 


3 


3 


4 


5 


Strategies for reducing test anxiety 


4 


5 


5 


3 


5 


4 


4 


3 


3 


5 


3 


3 


3 


5 




O 
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Learning Strategies Self-Assessment 



A-1 1 



PRE SELF-ASSESSMENT 


155 


156 


157 


158 


159 


160 


161 


162 


163 


164 


165 


166 


167 


168 
































Self rating as a learner . 


4 


5 


4 


3 


5 


4 


3 


4 


2 


3 


3 


3 


4 


4 


Readiness for training 


5 


5 


5 


3 


4 


5 


5 


5 


4 


4 


3 


4 


4 


5 


Ability to take lecture notes 


4 


4 


4 


3 


4 


3 


3 


4 


2 


3 


3 


3 


3 


4 


Skimming material before reading 


4 


1 


4 


2 


4 


3 


4 


4 


3 


2 


3 


3 


3 


4 


Highlighting key information 


3 


2 


4 


3 


3 


3 


4 


5 


3 


2 


3 


3 


4 


4 


Understanding of open/closed questions 


3 


2 


4 


3 


3 


3 


4 


4 


1 


2 


2 


3 


3 


4 


Knowledge of test-taking strategies 


3 


1 


3 


2 


3 


4 


3 


4 


2 


3 


2 


3 


3 


4 


Strategies for reducing test anxiety 


3 


1 


3 


1 


3 


4 


3 


3 


2 


2 


1 


3 


2 


4 
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Self rating as a learner 


5 


4 


4 


4 


5 


5 


5 


3 


3 


3 


4 


4 


3 


3 


Readiness for training 


5 


4 


5 


5 


5 


4 


5 


3 


4 


4 


4 


4 


3 


4 


Ability to take lecture notes 


4 


3 


5 


5 


4 


4 


5 


2 


4 


2 


3 


3 


4 


5 


Skimming material before reading 


4 


4 


4 


5 


4 


4 


2 


2 


4 


2 


3 


3 


4 


3 


Highlighting key information 


5 


3 


5 


5 


4 


4 


5 


5 


3 


2 


4 


4 


4 


5 


Understanding of open/closed questions 


4 


4 


5 


5 


5 


5 


3 


3 


3 


3 


4 


3 


5 


4 


Knowledge of test-taking strategies 


4 


3 


4 


4 


5 


5 


3 


3 


4 


2 


3 


3 


5 


3 


Strategies for reducing test anxiety 


5 


5 


4 


5 


5 


4 


2 


1 


3 


1 


3 


4 


5 


5 
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PRE SELF-ASSESSMENT 


169 


170 


171 


172 


173 


174 


175 


176 


177 


178 


179 


180 


181 


182 
































Self rating as a learner 


3 


5 


5 


4 


3 


4 


4 


3 


5 


4 


4 


4 


3 


4 


Readiness for training 


4 


5 


5 


4 


4 


5 


3 


5 


5 


4 


5 


4 


4 


3 


Ability to take lecture notes 


3 


4 


5 


3 


4 


4 


3 


4 


5 


3 


5 


5 


3 


4 


Skimming material before reading 


2 


4 


5 


2 


3 


4 


3 


2 


5 


3 


4 


5 


4 


5 


Highlighting key information 


4 


5 


4 


2 


3 


3 


4 


4 


5 


4 


5 


5 


3 


4 


Understanding of open/closed questions 


4 


4 


3 


3 


2 


4 


4 


1 


4 


3 


5 


3 


3 


2 


Knowledge of test-taking strategies 


4 


5 


4 


3 


2 


4 


3 


3 


5 


3 


4 


5 


3 


4 


Strategies for reducing test anxiety 


1 


5 


4 


3 


2 


4 


3 


2 


4 


3 


5 


5 


3 


1 
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Self rating as a learner 


, 4 


5 


2 


3 


4 


3 


4 


5 


3 


4 


5 


3 


5 


4 


Readiness for training 


4 


4 


5 


4 


4 


4 


5 


5 


3 


3 


4 


3 


5 


5 


Ability to take lecture notes 


5 


3 


3 


4 


3 


3 


5 


5 


3 


4 


5 


2 


5 


4 


Skimming material before reading 


5 


4 


2 


4 


3 


3 


5 


5 


3 


4 


4 


3 


5 


4 


Highlighting key information 


3 


4 


3 


5 


4 


4 


4 


5 


3 


4 


5 


2 


5 


4 


Understanding of open/closed questions 


3 


3 


3 


5 


3 


4 


5 


5 


3 


4 


5 


2 


5 


4 


Knowledge of test-taking strategies 


4 


3 


2 


3 


4 


3 


4 


5 


3 


3 


5 


3 


5 


4 


Strategies for reducing test anxiety 


5 


3 


2 


4 


4 


3 


5 


5 


3 


3 


4 


3 


5 


5 
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A-13 




PRE SELF-ASSESSMENT 


183 


184 


185 


186 


187 


188 


189 


190 


191 


192 


193 


194 


195 


196 
































Self rating as a learner 


4 


4 


3 


3 


4 


5 


3 


5 


4 


4 


5 


4 


4 


4 


Readiness for training 


5 


5 


5 


5 


4 


5 


4 


4 


5 


3 


5 


3 


5 


4 


Ability to take lecture notes 


3 


4 


2 


5 


3 


5 


4 


5 


2 


4 


5 


2 


5 


4 


Skimming material before reading 


2 


4 


4 


5 


3 


4 


4 


4 


2 


3 


5 


4 


4 


3 


Highlighting key information 


4 


4 


2 


4 


4 


5 


3 


5 


3 


4 


5 


3 


3 


3 


Understanding of open/closed questions 


2 


4 


1 


3 


3 


5 


2 


5 


3 


1 


5 


3 


4 


3 


Knowledge of test-taking strategies 


3 


4 


3 


4 


4 


4 


3 


4 


4 


3 


4 








Strategies for reducing test anxiety 


3 


4 


1 


3 


4 


4 


2 


4 


5 


3 


4 
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Self rating as a learner 


5 


4 


5 


5 


5 


4 


3 


4 


4 


4 


5 


5 


3 


5 


Readiness for training 


5 


4 


4 


5 


5 


4 


3 


4 


4 


4 


5 


5 


3 


4 


Ability to take lecture notes 


4 


4 


5 


4 


5 


3 


3 


3 


3 


4 


5 


4 


3 


5 


Skimming material before reading 


4 


5 


5 


5 


5 


5 


3 


3 


3 


5 


5 


4 


3 


5 


Highlighting key information 


4 


4 


4 


5 


5 


4 


4 


3 


4 


5 


5 


5 


3 


5 


Understanding of open/closed questions 


5 


5 


4 


5 


5 


5 


2 


5 


4 


5 


5 


5 


2 


5 


Knowledge of test-taking strategies 


5 


4 


4 


5 


5 


5 


3 


4 


3 


5 


5 








Strategies for reducing test anxiety 


5 


4 


5 


4 


5 


5 


3 


4 


3 


4 


5 
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A-14 




PRE SELF-ASSESSMENT 


197 


198 


199 


200 


201 


202 


203 


204 


205 


206 


207 


208 


209 


210 
































Self rating as a learner 


1 


5 


4 


4 


5 


5 


5 


5 


4 


3 


5 


5 


4 


4 


Readiness for training 


5 


5 


4 


5 


5 


5 


5 


5 


5 


5 


4 


5 


5 


5 


Ability to take lecture notes 


1 


4 


5 


4 


4 


5 


5 


5 


4 


4 


4 


5 


4 


4 


Skimming material before reading 


5 


4 


5 


4 


4 


5 


5 


5 


4 


4 


4 


5 


4 


4 


Highlighting key information 


5 


5 


4 


4 


3 


5 


5 


5 


4 


3 


5 


5 


3 


4 


Understanding of open/closed questions 


5 


4 


3 


4 


4 


4 


5 


4 


2 


3 


3 


5 


2 


3 


Knowledge of test-taking strategies 
















4 


4 


3 


4 


5 


4 


3 


Strategies for reducing test anxiety 
















1 


4 


2 


5 


5 


3 


3' 
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Self rating as a learner 


3 


5 


4 


5 


3 


2 


5 


5 


5 


5 


5 


5 


4 


4 


Readiness for training 


3 


4 


3 


5 


4 


4 


5 


5 


5 


5 


5 


4 


5 


5 


Ability to take lecture notes 


3 


4 


4 


5 


2 


4 


4 


5 


4 


4 


5 


5 


5 


5 


Skimming material before reading 


5 


5 


4 


5 


4 


4 


4 


4 


3 


5 


5 


5 


3 


4 


Highlighting key information 


4 


5 


4 


5 


4 


4 


4 


5 


5 


5 


5 


4 


1 


4 


Understanding of open/closed questions 


4 


4 


5 


5 


5 


4 


4 


4 


5 


4 


5 


5 


5 


4 


Knowledge of test-taking strategies 
















4 


5 


4 


5 


4 


3 


4 


Strategies for reducing test anxiety 
















5 


5 


4 


5 


5 


2 


4 
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A-15 



PRE SELF-ASSESSMENT 


211 


212 


213 




Average 


Median 


Mode 


















Self rating as a learner 


4 


3 


4 




3.93 


4 


4 


Readiness for training 


5 


5 


5 




4.41 


5 


5 


Ability to take lecture notes 


4 


4 


5 




3.78 


4 


4 


Skimming material before reading 


4 


4 


4 




3.72 


4 


4 


Highlighting key information 


5 


5 


4 




3.96 


4 


4 


Understanding of open/closed questions 


5 


4 


4 




3.44 


4 


4 


Knowledge of test-taking strategies 


4 


4 


4 




3.53 


4 


4 


Strategies for reducing test anxiety 


4 


3 


4 




3.24 


3 


3 
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Average 


Mean 


Mode 


Self rating as a learner 


1 


5 


4 




4.23 


4 


5 


Readiness for training 


5 


5 


5 




4.43 


5 


5 


Ability to take lecture notes 


2 


5 


5 




4.10 


4 


5 


Skimming material before reading 


1 


5 


4 




4.07 


4 


4 


Highlighting key information 


5 


4 


4 




4.24 


4 


5 


Understanding of open/closed questions 


4 


5 


5 




4.21 


4 


5 


Knowledge of test-taking strategies 


3 


3 


5 




4.06 


4 


4 


Strategies for reducing test anxiety 


4 


4 


5 




4.15 


4 


5 
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A-16 



Date ref. 

11/14/97 

11/10/97 

10/8/97 



8/8/95 




10/8/96 



Ques 1 

4 

. 5 

4 

4 

5 
5 
5 

4 

5 
5 

4 

5 

3 

4 

4 

5 

4 

5 

3 

4 

4 

5 
3 
5 
5 
5 
5 
5 
5 



Ques 2 

4 

4 

5 

4 

5 
5 
5 

4 

5 
5 
5 
5 
4 
3 

3 

4 

3 

4 
3 
3 

3 

4 
3 

5 
5 
1 
5 
5 
5 



Ques 3 

4 

4 

5 

4 

5 
5 

4 

5 
5 
5 
5 
5 
4 

3 

4 

5 

3 

4 
4 
3 

3 

4 

4 

5 
5 
3 
5 
5 
5 



Average Ratings 4.45 4.10 4.31 

Questions: 

1 .The purpose and objectives of the sesion were clear. 
1 -strongly disagree 

2- disagree 

3- neither agree nor disagree 

4- agree 

5- strongly agree 



Ques 4 

4 

4 

5 

4 

5 
5 
4 

4 

5 
5 
5 
5 
5 
3 

3 
5 

4 
4 
4 

3 

4 
4 

4 

5 
5 
3 
5 
5 
5 



Ques 5 

4 

5 
4 

4 

5 
5 
4 
4 



4.34 4.38 



2. The content was appropriate to my needs. 

3. The knowledge and skills gained from this session will help me in the rest of the 1 00-hour training. 

4. The overall quality of this session was excellent. 

5.1 anticipate being able to apply what I learned in this session to my job. 

6. What materials, activities, etc., did you like best? 

Learner Comments: 

Videos, instructor going over the material and tests in a manner and tone of voice that helps you 
to retain the information. 

The videos and listening to other aides on the videos to get input to better give me more 
understanding on how patients need to be better taken care of. 
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Learning Strategies Alternative Self-Assessment 



I liked all the materials. 

Hands-on training. 

Different lecturers providing informative experiences-group discussions-videos were informative. 
Hands-on training. 

Hearing the views of students and their experiences; the detail of the subject presented 
(ex. Open/closed questions ) 

The video presentation was excellent. 

there were real people in the video that actually went through the course, not actors, 
the Learning Strategies Inventory 

The video tapes, notes, activities were funa swell as very informing. I enjoyed the representatives 
very much! 

The discussion after and during the activity and the relaxed manner in which it was approached. 

The activities that made you think after making a statement and realizing a different outlook or 
approach and being open-minded and ready for change. 

Watching TV , a list, jotting down notes; all of us communicated about everything. 

The cards are a big PLUS 
I liked the cards that were handed out. 

Class discussions 
the talking 

Skimming techniques 

I liked talking, learning, and personalizing it to make it easier. 

The videos and listening to other aides on the videos to get input to better give me more 
understanding on how patients need to be better taken care of. 

To be open, take notes, ask lots of questions, be prepared by your training and studying for the job. 
I liked them all. 

I really liked the videos. I think they really put things into perspective. 
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A- 18 




classref. 


goals yes 


goals no 


interest 


use on job 


difficulty 


use in life 


expected 


materials 


recom yes 


recom no 
























12/30/96 


1 




4 


5 


4 


5 


3 


4 


1 






1 




3 


3 


3 


3 


3 


3 


1 






1 




4 


5 




4 


5 


4 


1 






1 




3 


3 


2 


3 


2 


2 


1 






1 




4 


5 


2 


3 


3 


3 


1 




11/14/97 


1 




5 


5 


4 


5 


5 


4 


1 






1 




5 


5 


3 


5 


5 


3 


1 






1 




4 


4 


3 


4 


4 


2 


1 




11/10/97 


1 




5 


5 


4 


5 


5 


4 


1 






1 




4 


4 


3 


3 


4 


2 


1 








1 


2 


3 


1 


4 


4 


1 


1 




6/11/97 


1 




4 


4 


1 


4 


3 


5 


1 






1 




5 


5 


3 


5 


3 


2 


1 






1 




5 


5 


3 


5 


4 


2 


1 






1 




5 


5 


5 


5 


5 


2 


1 






1 




5 


5 


3 


5 


3 


1 


1 






1 




5 


5 


3 


5 


4 


3 


1 






1 




4 


5 


1 


5 


4 


4 


1 








1 


2 


2 


1 


2 


2 


2 


1 




4/7/97 


1 




5 


5 


4 


5 


5 


1 


1 






1 




4 


4 


1 


4 


3 


1 


1 






1 




5 


5 


3 


5 


5 


2 


1 






1 




5 


5 


5 


5 


1 


5 


1 






1 




5 


1 


2 


4 


3 


1 


1 






1 




4 


3 


2 


2 


3 


1 


1 








1 


5 


1 


1 


5 


1 


1 








1 




5 


5 


3 


5 


5 


4 




1 




1 




5 


5 


4 


5 


5 


5 


1 




4/21/97 


1 




5 


5 


3 


3 


3 


1 


1 






1 




5 


5 


4 


4 


4 


4 


1 








1 


3 


3 


1 


3 


3 


1 


1 






1 




5 


5 


3 


4 


5 


5 


1 






1 




3 


3 


1 


3 


3 


1 


1 






1 




5 


4 


2 


4 


4 


5 


1 






1 




5 


4 




4 


5 


4 


1 






1 




4 


3 


3 


3 


3 


3 


1 




10/15/97 


1 




5 


5 




5 


5 


2 


1 






1 




5 


5 


3 


5 


4 


3 


1 








1 


5 


4 


3 


2 


3 


3 


1 






1 




5 


5 


1 


4 


5 


1 


1 








1 


5 


4 


3 


4 


2 


2 


1 




10/14/97 


1 




5 


5 


3 


5 


5 


4 


1 






1 




4 


5 


3 


4 


3 


4 


1 






1 




5 


5 


5 


5 


1 


3 


1 






1 




3 


4 


3 


5 


2 


1 


1 






1 




5 


5 


3 


5 


4 


3 


1 






1 




4 


3 


3 


4 


3 


1 


1 






1 




4 


4 


2 


4 


3 


2 


1 






1 




5 


5 


3 


4 


3 


3 


1 






1 




3 


4 


2 


4 


1 


2 


1 




11/21/96 




1 


5 


5 


3 


3 


3 


2 : 


1 






1 




5 


5 


3 


3 


3 


2 


1 








1 


3 


4 


3 


4 


3 


2 


1 




10/29/96 


1 




4 


5 


3 


3 


1 


3 


1 






1 




4 


5 


3 


3 


5 


2 


1 






1 




4 


5 


2 


4 


3 


2 


1 








1 


3 


3 


2 


2 


2 


1 


1 








1 


4 


4 


1 


2 


3 


1 


1 






1 




3.5 


3.5 


2 


3 


3 


1 


1 






1 




4 


5 


3 


2 


4 


4 


1 




6/25/96 


1 




5 


5 


2 


5 


3 


1 


1 






1 




4 


5 


3 


3 


3 


3 


1 








1 


5 


5 


1 


3 


2 


1 


1 






1 




5 


5 


5 


5 


5 


5 


1 






1 




5 


5 


5 


5 


5 


5 


1 




Totals 


54 


11 














63 


1 


Average Ratings 




4.35 


4.33 


2.73 


3.97 


3. 45 | 2.S7 
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Questions: 

1 . Were the scenarios realistic? 

2. Did you enjoy the brief video scenarios? 

3. Did you recognize behaviors of anyone you work with? 

4. Did you recognize some of your own behaviors? 

5. Were the learning points clear to you? 

6. Was much of the information new to you? 

7. Did the module make you think about the way you talk on the telephone? 

8. Are you more aware now than you were before about the difficulties of communicating 
on the telephone? 

9. Do you think the other staff in your facility should work on their telephone skills? 

1 0. Was anything left out that you believe to be important? 

1 1 . Do you have any comments or suggestions? (Space to write in--see below) 

12. Would you be willing to promote this workshop/topic among others at your worksite? 
Alternate questions used on 2/6/97: 

1 0. Should this have been longer to cover more information? 

1 1 . Did you learn new skills that you will use? 

1 2. Do you think the handouts are useful? 

1 3. Do you have any comments or suggestions? 

14. Would you be willing to promote this workshop/topic amoung others at your worksite? 

Participant Comments from pilot course focus groups 

Well done. Change clothing as discussed. 

More professional clothing; when the RN was speaking, she needed 
to state that the Patient needed to go to x-ray. 

Need to include recognizing and validating caller's anger or problem. 

Staff should be more professionally dressed to give an expectation on dress code. 

Time considerations are always a problem for presenting to staff on patient care units. 

2 hours wont be feasible unless staff are off unit for a full day. 

Dress code. 

Wearing apparel. Better image. 
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Responses:! Date Ref i Ql-yes 


Q1-no 


Q2-yes i Q2-no j Q3-yes 1 Q3-no i Q4-yes Q4-no 


t 




1 i 


i 


1/29/97 i 1 




1 I _ 


1 1 


! 1 




1 


i i 


! i 




1 




i i 


i i 




1 




i i 


1 t 


1 




i i 


' ; 1 


1 


I i i 


: i 




1 


1 i L_ 


! 1 






i , 


2/6/97 1 




i ; i i 


! 1 




1 


i i : i 


! ! 1 




1 




1 1 1 




! i i 




; 1 


1 : 1 




i i 




! i 




1 ! 1 




i 


1 




I 1 




i 1 P i : 






1 




! i 




i 


1 i 






1 




1 




1 ; 


i ! 




i 


1 




i i 




1 


! 1 


1 


1 




! i 




i 


i ' 


i 


1 




i 




1 1 ; 


i 






1 




1 




i 


i j 






1 




1 




i i 


!_ _ — 






1 




1 






i ; 














1 ! 


! ; 






1 




1 




i ; 


! 1 


Total 




22 


0 


21 


1 


20 | 2 


19 1 3 1 


Percent 


(n=23) 


95.65% 


0.00% 


91.30% 


4.35% 


86.96% i 8.70% 


82.61% | 13.04% 



I RJC P re P arec * by PPLC, Inc. 



12G 



May, 1998 



Tier II: Calling for Care Post-Survey 



A-21 



Q5-yes 


Q5-no 


Q6-yes 


Q6-no i Q7-yes 


1 Q7-no | Q8-yes j Q8-no 


Q9-yes Q9-no 








1 

i 


1 i 




1 




1 




1 


1 

I 


r 1 


1 


1 






1 


1 


I 


1 


1 


1 






1 


1 




1 ! 1 


1 






1 


1 




1 ! 1 


1 






1 


1 




i : i 


1 




1 


1 


; i i 


i 1 




1 L 1 


; i i 






I 


i T * 


i 




1 


i 


i : i i 


i : 1 , 


1 


i i 


i i 1 i 


1 






1 


i i 




i i i 


1 






1 


| i 




1 ' 1 : 


1 






1 


! i 




1 


1 


1 






1 




1 




1 


| 1 


1 






1 


1 




1 




i 


1 






1 


1 




1 




1 




1 






1 


1 




1 




1 




1 






1 


1 




1 


1 




1 






1 


1 




1 1 1 


1 




1 






1 


1 




1 




i 


1 


1 






1 


1 




1 




i 


i 


1 




1 




1 






1 


1 
























1 




1 




1 




i ! 


1 




22 


0 


3 


19 


21 


1 


19- 3 


21 


1 


95.65% 


0.00% 


13.04% 


82.61% 


91.30% 


4.35% 


82.61% 1 13.04% 


91.30% 


4.35% 
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Q1 0-yes ) QlO-no 


Q1 1 -yes 


Qll-no 


Q1 2-yes | Q12-no 


Q1 3-yes ! Q13-no | Q1 4-yes 


Q14-no 


1 








\ t 




! 1 


1 


! i 1 


| i 




i : 


1 


: i 










i 


1 


! i 






! 


i 


i ! 


1 


1 1 






r ; 






i ! i 




: i 


1 : 1 


; i 






1 f 1 


! 1 




i 


- 1 


i 






1 1 


! 1 




1 1 


1 1 


i 1 ' 1 . 




1 i '1 


^ 1 


1 


: i 1 




i : i ! 


1 




I ! : i . 




1 1 1 


1 i H 


1 


1 


1 




1 i 1 


! i 




1 




1 


1 




i 


i 1 


1 




1 




! i 


1 




1 




1 




1 






1 


1 






1 




1 


1 






1 


1 






1 


1 






1 




1 


1 






1 


1 






1 




1 


1 






1 


1 




1 






i 1 


1 






1 


1 




1 






1 


1 






1 


1 




1 






1 


1 
























1 




1 




1 






1 


1 




5 


17 


17 


5 


19 


3 


0 


- 15 


13 


2 


21.74% 


73.91% 


73.91% 


21.74% 


82.61% 


13.04% 


0.00% j 


65.22% 


56.52% 


8.70% 
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class ref. 


Ques 1 


Ques 2 


Ques 3 


Ques 4 


Ques 5 


6/6/96 


5 


5 


5 


5 


5 




5 


5 


5 


4 


4 




3 


1 


3 


3 


3 




5 


4 


5 


4 


4 


2/11/97 


5 


4 


4 


5 


5 




5 


5 


5 


5 


5 




1 


1 


4 


4 


4 




4 


3 


5 


4 


4 




4 


3 


2 


3 


4 




4 


3 


3 


4 


4 




5 


4 


5 


5 


4 




5 


5 


4 


5 


5 


Average 


4.25 


3.58 


4.17 


4.25 


4.25 



Questions: 

1 . The purpose and objectives of the session were clear. 
1 -strongly disagree 

2- disagree 

3- neither agree nor disagree 

4- agree 

5- strongly agree 



2. The content was appropriate to my needs and interests. 

3. The knowledge and skills gained from this session will help me 

4. The overall quality of this session was excellent 

5. 1 anticipate being able to apply what I learned in this session to 



perform my job better 
my job. 



Participant Comments: 

7. What materials, activities, etc., did you like best? 

The workbook and discussions about the workplace 

Everything was of value 

Flip chart and discussions 

Discussing problems on the job 

The TAKE A MOMENT sheet 

Talking about individual situations at work. 
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class ref. 


goals yes 


goals no 


Interest 


use on job 


difficulty 


use In life 


expected 


materials 


recom yes 


recom no 


11/20/96 


1 




4 


5 


2 


5 


2 


1 


1 






1 




5 


3 


3 


3 


4 


2 


1 








1 


4 


5 


1 


5 


4 


1 


1 






1 




5 


4 


1 


5 


3 


2 




1 




1 




5 


5 


3 


3 


3 


1 


1 




10/31/96 


1 




5 


5 


3 


5 


1 


1 


1 






1 




3 


2 


2 


3 


3 


5 


1 






1 




4 


4 


3 


4 


3 


4 


1 






1 




3 


3 


1 


1 


3 


1 


1 






1 




3 


3 


3 


3 


3 


2 


1 








1 


3 


3 


3 


3 


1 


2 


1 








1 


1 


1 


1 






1 










1 


3 


3 


3 


3 


3 


1 


1 






1 




4 


5 


2 


4 


4 


1 


1 






1 




4 


4 


3 


3 


4 


4 


1 








1 


3 


3 


1 


1 


3 


1 


1 






1 




4 


4 


2 


3 


4 


1 


1 






1 




4 


4 


5 


3 


4 


5 


1 






1 




3 


2 


1 


1 


1 


4 


1 






1 




4 


3 


3 


3 


3 


5 


1 








1 


2 


1 


1 


1 


1 


1 


1 






1 




4 


4 


4 


4 


4 


4 


1 






1 




4 


4 


3 


3 


4 


1 


1 






1 




3 


3 


3 


2 


2 


2 


1 






1 




4 


4 


1 


3 


4 


4 


1 






1 




4 


4 


2 


3 


4 


2 


1 






1 




4 


5 


1 


4 


4 


4 


1 






1 




4 


4 


2 


4 


4 


1 


1 




5/1 2/97 


1 1 




5 


5 


3 


4 


3 


1 


1 






1 




4 


5 


3 


4 


5 


3 


1 






1 




4 


4 


3 


4 


2 


3 


1 






1 




5 


4 


1 


4 


5 


1 


1 




4/28/97 


1 




5 


5 


1 


4 


3 


1 


1 






1 




3 


3 


2 


3 


4 


2 


1 






1 




4 


4 


2 


3 


3 


2 


1 




10/30/96 


1 




4 


4 


5 


3 


4 


5 


1 






1 




4 


5 


2 


4 


4 


1 


1 






1 




4 


4 


2 


2 


3 


2 


1 






1 




4 


4 


2 


3 


2 


1 


1 








1 


3 


3 


1 


1 


3 


1 


1 






1 




4 


4 


3 


3 


4 


4 


1 




7/1/96 




1 


3 


3 


3 


3 


3 


1 


1 






1 




5 


5 


3 


3 


5 


1 


1 








1 


4 


4 


4 


4 


4 


5 


1 






1 




5 


4 


1 


1 


5 


1 


1 






1 




4 


5 


2 


4 


3 


1 


1 






1 




4 


4 


2 


3 


3 


3 


1 






1 




4 


4 


3 


3 


2 


4 


1 




Total 


39 


9 














46 


1 


Av Rating 






3.85 


3.81 


2.31 


3.15 


3.26 


2.23 
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Pre Ques 1 


Pre Ques 2 


Pre Ques 3 


Pre Ques 4a 


Pre Ques 4b 




5 


5 


5 


5 


5 




4 


3 


5 


5 


4 




4 


4 


4 


5 


5 




5 


5 


5 


5 


5 




5 


4 


4 


3 


4 


Av Rating 


4.6 


4.2 


4.6 


4.6 


4.6 





Post Ques 1 


Post Ques 2 


Post Ques 3 


Post Ques 4a 


Post Ques 4b 




5 


5 


5 


5 


5 




5 


5 


5 


5 


4 




5 


5 


5 


5 


5 




5 


5 


5 


5 


5 




5 


5 


5 


4 


5 


Av Rating 


5 


5 


5 


4.8 


4.8 



1 . On the following scale, rate your understanding of the conditions that affecct how and when you 
can provide personal care for a resident 

1 - 1 am unsure what conditions affect how and when I will provide personal care for a resident. 

5- 1 understand what conditions affect how and when I will provide personal care for a resident. 

2. On the following scale, rate your understanding of an appropriate order for providing care 
for residents. 

1 -I am unsure of an appropriate order to provide personal care for a resident. 

5-1 can list in an appropriate order the personal care tasks required for a resident. 

3. On the following scale, rate your ability to efficiently plan an order of care for many residents. 

1-1 am unsure how to provide care for many residents in an appropriate order. 

5-1 can efficiently plan the care for many residents according to an appropriate order. 

4a.On the following scare rate your knowledge of the conditions that will affect how you 
manage your assignment. 

1 - 1 am unsure of the conditions that will affect how I manage my assignment. 

5-1 know what conditions will affect how I manage my assignment. 



4b. 

1 -I am not sure why to prioritize the tasks of my job assignment. 

5-1 understand the need to prioritize the tasks of my job assignment. 
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class ref. 


goals yes 


goals no 


interest 


use on job 


difficulty 


use in life 


expected 


materials 


recom yes 


recom no 


tenure-yrs. 


6/26/96 






4 


3 


3 


3 


3 


1 


1 




1 3.5 




1 




5 


5 


2 


5 




1 


1 




2 




1 




5 


5 


1 


5 


5 


5 


1 




3.5 




1 




5 


5 


3 


4 


5 


1 


1 




2 




1 




5 


4 


3 


3 


4 


1 


1 




19 




1 




4 


4 


2 


4 


1 


3 


1 




23 




1 




4 


4 


3 


3 


4 


1 


1 




0.75 




1 




2 


4 


3 


4 


4 


2 


1 




3 




1 




5 


5 


3 


5 


3 


1 


1 




9 




1 




5 


5 


2 


4 


3 


1 


1 




0.25 


10/30/96 


1 




3 


3 


3 


2 


2 


2 


1 




2.5 




1 




4 


4 


3 


3 


4 


1 


1 1 




2 








4 


4 


4 


4 


4 


4 


1 




5 






1 


5 


5 


1 


2 


2 


2 


1 




4.5 






1 


2 


1 


1 


1 


1 


1 


1 




2.5 




1 




4 


3 


3 


3 


3 


5 


1 




4 




1 




3 


2 


1 


1 


1 


4 


1 




1.5 




1 




4 


4 


2 


4 


4 


1 


1 




6 




1 




4 


5 


1 


4 


4 


4 


1 




0.75 








5 


5 


5 


3 


3 


5 


1 




2.5 




1 




4 


4 


1 


3 


4 


4 


1 




2 




1 




5 


5 


3 


4 


3 


2 


1 




3.5 




1 




5 


3 


4 


4 


3 


4 


1 




4 




1 




4 


4 


2 


2 


1 


2 


1 




4 






1 


4 


4 


3 


3 


3 


2 


1 




5 






1 


4 


4 


2 


2 


2 


1 


1 




2 






1 


4 


4 


1 


4 


1 


4 


1 




3.5 






1 


3 


3 


3 


3 


3 


1 


1 




1 






1 


1 


1 


1 


1 


1 


1 






3.5 






1 


3 


3 


3 


3 


1 


2 


1 




6 








5 


5 


4 


5 


5 


5 


1 




7 




1 




3 


3 


3 


3 


3 


2 


1 




8 








3 


3 


1 


1 


3 


1 


1 




7 




1 




P 4 


4 


3 


4 


3 


4 


1 












3 


1 


3 


5 


5 


5 










1 




3 


2 


2 


3 


3 


5 


1 






Total 


22 


8 














34 


0 




Av Rating 






3.89 


3.69 


2.44 


3.25 


2.97 


2.53 






4.66 





Positions: 

RN 

LPN 

Charge nurse 
Staff RN 
Chaplain Aide 
Cert. Nursing Asst. 
Nursing Cert. Nurs. Asst. 
Case Manager 
Nursing Supervisor 
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Comments: 



It has helped me identify the need to better explain myself to staff and to look at how I say what is 
heard and stress relievers. 

With the knowledge required, I now have an understanding of wht a CNA will learn, can build on it and 
follow up with the skills that were reviewed. I can build on team work knowledge with other coworkers. 
I work team communications; knowing what CNA's have knowledge of is vital. 

Covers all aspects of learning their job duties. 

I now have increased confidence as an essential member of a mentoring team and raised awareness 
that my efforts are desired and appreciated. 

Able to communicate better with the CNA's. 

Now understand CNA's better and their ability to handle their assignment. Also found more ways to 
handle my own stress. 

To be more understanding of other workers and new CNAs on the floor. 

Identified what the training course for CNAs is; now I can help motivate CNAs. 

For the stress and communication skills; how to deal with CNAs in better ways. 

Increased understanding; reducing stress, increasing insight. 

In understanding the CNAs' role. 

A friend of mine wants to get into CNA work. I think that this program will give her the knowledge and 
also an understading of the elderly. 

It's always good to stay in tune with yourself and others because most of the time we forget and take 
things for granted. 

Communicate more effectively and understand the outlook of new CNAs. 

Now able to break down my expectations of CNAs so that they can understand and work effectively 
and they know what I expect. 

This gives a breakdown on how staff function at present showing where things need to be strengthened. 
Giving me information to build uponin understanding the importance of all job roles and the need for 
team understanding as well as team effort and teamwork. 

Be patient and more understanding of new CNAs 

To be able to be more organized myself and use my time more efficiently. 

As a beginning towards understanding where healthcare interrelations need work. 

It has helped me understand what type of information that the employees have already learned about 
and will enable me to start from that point in any further training with them. 

It is more realistic that the other previous training classes (that I had). 

It gives you a more realistic view of your work outside of the CNAs training classroom. 

I think it would be extremely helpful to new CNA trainees in adjusting to their jobs--especially good in 
time management. 

It's a good thing to go through before going onto the floors to learn more. 
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class ref. 


goals yes 


goals no 


interest 


use on job 


difficulty 


use in life 


expected 


materials 


recom yes 


recom no 


9/30/96 


1 




4 


5 


2 


5 


1 


2 


1 






1 




4 


4 


3 


3 


4 


2 


1 






1 




3 


3 


1 


3 


3 


1 


1 






1 




4 


4 


1 


3 


4 


1 


1 






1 




4 


4 


1 


4 


3 


1 


1 






1 




3 


4 


2 


4 


3 


1 


1 






1 




3 


4 


1 


4 


4 


3 


1 




11/18/96 


1 




4 


5 


4 


1 


2 


3 


1 






1 




5 


5 


1 


5 


2 


1 


1 






1 




5 


5 


3 


4 


5 


4 


1 






1 




3 


3 


2 


4 


1 


3 


1 






1 




3 


3 


2 


4 


1 


3 


1 






1 




4 


4 


2 


3 


3 


4 


1 
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Tier I Pre/Post Scores 



A-29 



Module 2: Understanding Your Assignment Sheet 
Beg. Date 

9/26/96 



12/15/97 



6/1 8/97 



4/9/97 



(3/1 6/97 




Module 3: Managing Your Assignment 
Beg. Date 

6/23/97 



3/28/97 



6/1 8/97 



4/14/97 



10/15/97 




PRETEST POSTTEST GAIN % OF GAIN 
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Module 4: Knowing and Understanding Your Resident 
Beg. Date 

3/2/97 



1/6/97 



1/15/97 



2/28/97 



Av Gain 
Av % Gain 
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POSTTEST 


GAIN 
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Module 5: Handling Stress on the Floor 
Beg. Date 
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Module 6: Communicating Effectively on the Floor 
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Learner Strategies Pre/Post Scores 



A-32 
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Appendix B: 



Sample PDP and PPLC Data Collection Instruments 




Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 

May, 1998 26 3 



The EDDY/Northeast Health/Rockefeller College WORKFORCE DEVELOPMENT PROGRAM 



PARTICIPANT PRE- and POST-PROGRAM SURVEY 
Today’s Date: 

Training Topic Title: 

Name of Your Affiliate: 

Your Job Title: 

How Long You Have Worked for The EDDY/Northeast Health: 



DIRECTIONS: Please answer the question below BEFORE you take this training: 
1. What do you expect to learn or review during this training? 



[At the end of this training session, you will be given several minutes to answer the 
questions on the other side of this form.] 



Performance Plus Learning Consultants, Inc. 
RR1, Box 91, Rockport, WV 26169-9576 
(304) 343-6861 FAX (304) 342-4996 



204 



The EDDY/Nonheast Health/Rockefeller College WORKFORCE DEVELOPMENT PROGRAM 



DIRECTIONS: After you have completed this training session, please take a few 
minutes to write brief answers to the questions below: 



1. What are a few of the most important things that you learned from this session? 









2. Would you recommend this training to a coworker? Why or why not? 



3. How do you plan to use what you’ve learned? 



4. If you could change one thing about this training session, what would you change? 



Thank you for taking time to answer these questions. Your information will be used to 
help strengthen this training. 



Performance Plus Learning Consultants, Inc. 
RR1, Box 91, Rockport, WV 26169-9576 
(304) 343-6861 FAX (304) 342-4996 
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The Eddy/ Rockefeller College Workforce Development Program 

(NWLP FY93) 

Pre/PostTraining Evaluation Survey Instruments 



PARTICIPANT POST-PROGRAM SURVEY 

Social Security # 

Date: 

Name of your Eddy affiliate: 



Directions: Please answer each question below. The information you give will be used to evaluate 
and help improve the program(s) you have attended. 



A. Background information: 

1. How long have you worked at The Eddy? 



2. How long have you worked in Elder Care? 



3. How long have you worked in your present position at The Eddy? 

4. What is your job title at The Eddy? 

5. What is your age? 

6. What is your sex? 

Male Female 



B. Course Information: 

7. What can you do now that you couldn't do before taking the Workforce Development Program 
course(s) in Essential Skills for the Care Team ? 



8. Did you miss any time from this training course? 
If so, how much time did you miss? 



Yes 



No 



9. 




Has this course helped you meet or work toward any of your personal goals? 
(If you checked yes, please answer the next part of the question) 

In what way? 



Yes 



No 



© 1990 Jorie W. Philippi, Licensed to Performance Plus Learning Consultants, Inc., Springfield, VA and 
Charleston, WV: 1991, 1992, 1993, 1994, 1995. 
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Level III Evaluation Instrument 

US Dept, of Education, OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College, 1995 



TO: 

FROM: 

SUBJECT: 

DATE: 



Pauline Pallozzi, Aimee Isabelle, Carol Arkins, Vicki Cummings 
Jorie Philippi, Performance Plus Learning Consultants 
Development of Performance Indicator Rating Scales 
October 23, 1995 



During our brainstorming session together in late May, we worked toward identifying 
measurable behaviors that can be used to determine the impact of basic skills training on 
job performance in your areas of supervisory responsibility. As a group, you suggested 
the following behavioral categories as capabilities that competent workers exhibit to a 
great degree, and average and less-than-average workers to lesser degrees: 



• communicating honestly and directly 

• displaying politeness 

• being cheerful and happy in work 

• being patient-oriented 

• following directions consistently and reliably 

• asking appropriate questions 



We then asked you to list the specific observable behaviors for each of these attributes that 
you would classify as indicators of either outstanding or poor performance when observed 
in workers you supervise. The results of those lists have been arranged as first drafts of 
performance indicator rating scales for use in the near future as instruments for pre/post 
employee basic skills training evaluation. 

Would you and any of your colleagues who would like input, either as a group or 
independently, please carefully review each of the attached performance indicator 
“snapshots” according to the directions on the next page and make suggestions for any 
improvements you would like to see? Our deadline for their return to Christine Katchmar, 
who will forward them to us for revisions, is November 20. Thank you for your assistance 
with this endeavor to work with you in preparing EDDY employees to better meet the job 
demands of today and tomorrow. 



Prepared by Performance Plus Learning Consultants, Inc. 
6 California Avenue, Charleston, WV? 53 11-2201 
(304) 343-6861 FAX (304) 342-4996 
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Level III Evaluation Instrument 2 

US Dept, of Education, OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College, 1995 



Directions 

1. Record your suggested changes right on your copies of the rating scales. 

2. Read each enclosed rating scale carefully. Delete or combine any behaviors listed 
under columns 5 or I that seem repetitive by crossing them out. Add any new 
behaviors that occur to you by writing them in the blank cells under the appropriate 
column. 



3. Re-read each list of behaviors under columns 5 and L Circle any behaviors that an 
average worker also would sometimes exhibit and indicate that they should be moved 
into the spaces under column 3 by drawing arrows. Add any additional specific 
behaviors that an average worker might be observed performing by writing them in the 
blank cells under column 3. 



4. Re-read each of the behaviors in the rating scale. Clarify any items that are not 
specific OBSERVABLE behaviors by rewording them or by adding job details and 
examples, as needed. 

5. Return your marked up copies of the performance indicator rating scale sheets to 
Christine Katchmar by Monday, November 20, 1995. Thanks for your help. 



Prepared by Performance Plus Learning Consultants, Inc. 
6 California Avenue, Charleston, WV 2531 1-2201 
(304) 343-6861 FAX (304) 342-4996 
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Level III Evaluation Instrument 

US Dept, of Education. OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College. 1995 



I. Communicating Honestly and Directly 



5 


3 


1 


Makes observations of patient 
and/or family members; seeks 
help; attempts to handle and 
report problems to appropriate 
person. 




Maintains silence. 


Tells supervisor if he/she has 
done anything wrong. 




Talks in circular fashion; causes 
supervisor(s) to have to search 
out information or answers. 






Discusses problems or issues 
with co-workers, rather than 
telling supervisor. 






Denies or tries to cover up any 
thing he/she has done 
incorrectly. 






Is unable to resolve minor issues 
with co-workers through 
communication, thereby causing 
conflicts. For example, when a 
co-worker doesn’t respond to a 
request immediately, then she/he 
gets upset with the co-worker and 
the situation escalates. 
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Level III Evaluation Instrument 

US Dept, of Education, OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College, 1995 



II. Displaying Politeness 



5 


3 


1 


Addresses patients by name. 




Ignores visitors to floor, e.g., 
even if he/she knows visiting 
person is “lost.” 


Says “please” and “thank you.” 




Exhibits gruff mannerisms; if 
he/she is having a bad day, you’d 
know it. 


Greets visitors. 




Uses a tone of voice that lets you 
know that, even though he/she is 
doing something for you, he/she 
is not happy about it 


Shows consideration for co- 
workers. 






Smiles frequently. 






Offers to help. 
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Level III Evaluation Instrument 

US Dept, of Education, OVAE National Workplace Literacy Demonstration Project 
Die EDDY in partnership with Rockefeller College, 1995 

HI. Being Cheerful and Happy in Work 



5 


3 


1 


Always smiling, especially when 
talking to patients. 




Frequently complains. 


Tries to get others who are 
"down” out of bad moods. 




Gives excuses when asked to do 
something. 


Exhibit positive attitude, e.g. way 
he/she walks, talks with people, 
etc. 




Slams doors. 






Drops things. 
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Level III Evaluation Instrument 

US Dept, of Education. OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College. 1995 



IV. Being Patient-Oriented 



6 



5 


3 


i 


Displays attitude of seeing each 
patient as an individual, e.g., 
whenever a patient needs 
something, tells RN. 




Exhibits attitude that patients 
should conform to his/her 
schedule. 


Makes sure that patient’s 
appearance is good before going 
to appointments (e.g., therapy) to 
uphold patient’s dignity. 




Refers to patients by bed numbers 
or as “that person.” 


Answers calls from those patients 
who aren’t assigned to them as 
well as those who are. 




Takes no action to answer lights 
of those patients who aren’t 
assigned to him/her, and 
sometimes does not respond 
quickly to lights of patients who 
are assigned. 






Seldom does “extras” for 
patients, e.g. watering flowers. 






Indicates that patient is always 
“wrong.” 
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Level III Evaluation Instrument 

US Dept, of Education, OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College, 1995 



. Following Directions Consistently and Reliably 



5 


3 


1 


Shows up for work and is on 
time. 




Only does things correctly when 
he/she is “in a good mood.” 


Does entire assignment, e.g. 
given a list of patients, extra 
duties, etc. 




Frequently needs to be reminded 
of duties during the shift. 


Displays attitude of expecting to 
complete assignment and gets 
done in reasonable amount of 
time. 




Spaces work out to fill shift. 


Displays willingness to do 
whatever is asked. 




Hides out in patients’ rooms, 
watches TV. 


Comes back and reports to 
supervisor on status of 
assignment if asked to complete 
certain tasks within a specified 
time. 




Reports to supervisor only right 
before going home; causes 
supervisor to seek out 
information. 


Exhibits self-initiative and 
organization; seldom needs to be 
given direction (e.g., picks up for 
co-worker having trouble without 
being asked). 














O 

FRir 
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CNA Job Task Analysis Interview 



Introduction 



Hello! My name is and I am from Rockefeller College. Did you receive my letter 

about this interview and the job observation [tomorrow]? As you know, the interview and job 
observation are part of the job task analysis for the Workforce Development Program. How much 
do you know about the Workforce Development Program' 7 [Based on the response, provide a 
brief description.] [Give the CNA two information sheets.] 

Through this program, additional ways for CNAs and HHAs to further develop their skills will 

be offered. The training will be provided on-site etc... The information I gather today is 

designed to help us develop the most meaningful training possible. 

Today we'll talk about your job and the skills that you use such as observation, listening and 
speaking, reading, writing, and math. I will begin by asking you background questions to help 
me better understand your work. Then we will talk more specifically about the different skills 
required for your job. 

1 his interview will take one hour. Then [date and time] I will go to your unit so you can show 
me your job as you are actually doing it. I'll be observing you from [ ] to [ ^Afterwards, we 

will pick a quiet spot away your work area to discuss any remaining questions you or I might 
have. That should take about 1 5 minutes. 

The information I am gathering is about the skills needed to perform the job of a CNA here at 
[the facility]. I will be focusing on the tasks that CNAs have to do; 1 will not be collecting 
information about your job performance. I will be taking notes during our interview, but these 
notes and any specific comments you make will be kept confidential. 

Do you have any questions before we get started? 
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Interview Questions tbrCNAs. 



rJA' ~ 



Background Information 

I'd like to stan by getting a little background information. 

1 . You are a CNA. is that right? How long have you been a CNA? 

- How long have you been with [this facility]? 

- Have you held other jobs here? 



2. Since you have been a CNA [at this facility], what training have you attended? 

- Inservice training? 

- Safety training? 

- Equipment training? 



3. Are there positions at [this facility] to which you would like to promote or transfer? 
- Are there additional skills/training you would need to be promoted? 



CNA Job 

Let's talk more specifically now about your job as a CNA. 

4. What are your primary job responsibilities? 

- What are the tasks that you do the most frequently and that are most critical. It may be 
helpful to think about what you do in a day from start to finish. 

5. What equipment and work aids do you use? 

6. What meetings do you attend as part of your job? 

- Do you offer ideas? 

- Do you need to take notes? 

- Are you required to do any follow-up activities based on the meetings? 

?. How do you see your work as being part of a team' 7 

- In what ways? In what situations? 

BEST COPY AVAILABLE 

8. What do you do when something goes wrong? 

- A piece of equipment breaks down or malfunctions? 

- Someone before you did not do a thorough job' 7 

- There are disagreements among co-workers? 

28 3 
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Interview Questions tor CNA*, pngc 3 



Workplace Basic Skills (communication, critical thinking, and mathematics) 

Now 1'cJ like to ask you about some specific skills you use while you're doing your job. 

9. When do you need to use observation skills as you are doing your job ? 

- WhatAvho do you need to observe? 

- For what purpose?? 

10. When do you need to use listening skills? 

- Who do you need to listen to? 

- For what purpose? 

1 1 . When do you need to use speaking skills 9 

- Who do you need to speak with? 

- For what purpose? 

12. What reading skills do you need? 

- When do you need to read? 

- What types of materials do you need to read? [Ask for examples of materials.] 

- Safety signs? 

- Forms? 

- Notes? 

- Instructions? 

- Manuals? 



13. What writing skills do you need? 

- When do you need to write information? 

- What type of writing do you need to do? [Ask for examples of materials.] 

- Forms? 

- Notes? 



14. What critical thinking skills do you need? 

- Decision-making (e.g., evaluating and choosing the best alternatives? 

- Problem-solving (e.g., generating alternative solutions to a problem)? 

- Knowing how to learn (e.g., learning and remembering new facts or processes)? 

- Creative thinking (e.g., suggesting new ideas, procedures or systems)? 

15. What mathematics skills do you need? 

- Computing numbers? 

- Charting numbers? p O a BEST COPY AVAILABLE 

- Measuring? c J 4 
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Workforce Education Program 

Finally, I'd like to ask you some questions that relate to the training we are developing for new 
CNAs 

1 6. Have you worked with newly hired CNAs? [If yes,] what do they do best? Why? 



1 7. What do newly hired CNAs find the most difficult? Why? 



18. What type of basic skills training would be helpful for new CNAs? 



19. How do you see the Workforce Education Program benefitting your unit? 

- Improving communications or teamwork? 

- Improving reading, writing, or math skills? 

- Improving safety? 

- Improving quality? 

- Encouraging employees to problem solve? 



20. What potential barriers do you see for new CNAs taking part in this training? 



2 1 . What suggestions do you have for this training? 

- about the content 

- about scheduling 

- for instructors 
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CNA Interview: Job Activity/Task Sheet 



Job Activity/Task: 

A. 1. Please describe [this activity/task] in general. 

- What is its purpose? 

- What is the desired outcome? 



Observation Skills 

0.1. In what ways do you need to observation skills while you're doing this task? 

0.2. How do you use your sense of sight, hearing, touch, and smell during this activity/task? 



Communication Skills 

C. 1 . In what ways do you need to communicate with co-workers, supervisors, residents, others as 
you're doing this task? 

- Is this mostly verbal, non-verbal, written, or how? 

- Do you use the phone, a pager? 

C.2. What is the purpose for the communication? 

C.3. What is the content of the communication? 

C.4. How do you decide what you have to speak to each person about. 

C.5. How do you receive instructions for doing this activity/task? 

C.6. How do you ask for help with this activity/task? 

C.7. What training did you receive for this activity/task? 



Teamwork Skills 

T. 1 . In what parts of this activity/task do you have to work with others as a team? 

T.2. How do you share information? 

- Is this mostly verbal, non-verbal, written, or how' 7 

T.3. How do you give each other feedback? 

- How do you know if you've worked together well? 

BEST COPY AVAILABLE 

1 .4, How do you resolve problems? 
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CNA Interview: Job Activity-Task Sheet, page 2 



Reading Skills 

R. 1 . What print materials or resources do you use to help you complete this task: for example, 
forms, reference manuals, books, notes, and so on? 



R.2. How do you decide what you have to read as you do this activity/task? 

R.3. What do you usually do with the information you read? [What is your purpose for reading 
these materials? 

- Follow directions? 

- Share it with co-workers" 

- Memorize or refer to it when necessary? 

- Complete forms? 

- Write reports? 



Writing Skills 



W. 1. What writing activities do you do in order to complete this activity/task? 

- Record data or take notes? 

- Chan data in a logbook? 

- Write or edit memos, letters or reports? 




W.2. 



What is the purpose for what you write? 



W.3. What is the content of what you write? 



W.4. How do you decide what you have to write as you do this activity/task? 



W.5. Who reads what you write? 

W.6. How does your supervisor know if what you write is up to standard? 



Problem-Solving and Decision-Making Skills 

P. 1 . How does this activity/task require you to think creatively? 

- Using new equipment? 

- Brainstorming ideas? 

- Implementing new procedures? 

- Making recommendations? 




P.2. 



What decisions do you need to make as you do this activity/task? 

- Deciding what to do? 

- Juggling priorities? 

- How do you know if you made the right decision? 
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Problem-Solving and Decision-Making Skills (continued) 



P.3. What problems do you have to analyze or solve as you do this activity. task? 

- Do you need to determine causes of errors or problems? 

- How do you usually come up with the solution? 

- Must you follow policies or rules? 

-Do you need to memorize or look up information or processes? 



P.4. What steps do you usually take to try to keep the problem from happening again? 



Mathematical Skilli Used on the Job 

M l. What math activities do you perform in order to complete this activity/task? 

- Taking inventory? 

- Matching, counting, comparing or estimating numbers? 

- Adding, subtracting, multiplying or dividing whole numbers? 

- Determining if numbers are within specifications or ranges? 

- Charting or graphing information? 

- Calculating measurements? 




M.2. 



Do you do these math problems in your head, by hand, using a conversion chart, 
a calculator, or how? 

- When do you use each method? 

- What degree of accuracy is required? 



M.3. What is the purpose for what you calculate? 

M.4. How do you decide what you have to calculate as you do this activity/task? 



M.5. Who uses what you calculate? 

M.6. How does your supervisor know if what you calculate is correct ? 



Equipment 

E. 1 . What equipment do you use as you do this activity/task? 
E.2. What do you use it for? 

E.3. How important is it to doing this activity/task? 
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Interview Questions for Nursing Supervisors 



Interview Questions for Nursing Supervisors 



Objectives for the job task analysis interview: 

- Gain general information about the work unit, e.g., work processes, job assignments, 
career advancement, anticipated changes in patient/resident care and equipment 

- Gain overview of CNA position 

- Gain information about basic skills'needed by CNAs 

- Solicit suggestions for curriculum content, learning processes, scheduling 



Departmental Overview 

1 . Would you please begin by describing your unit? 

- What type of unit is it? 

-How large? How many residents/patients? 

2. What are the primary responsibilities of your unit? 

-Does much of the work involve other departments? 

3. How many positions are in your unit? 

-What are the job titles of the positions? 

- How many employees do you supervise? 

4. Are there other units similar to your unit in this facility? 

- How many? 

- What do they do? 

. Has your unit experienced many changes within the last five years or so? 

- New technology? 

- New work processes? 

- Higher quality standards? 

- Increased patient/client demands? 

- Increased regulatory demands? 

6. Do you expect many changes to the unit in the future? 

- What type of changes and when? 

- How are the changes expected to impact employees? 

7. We’ve been talking about change in the unit. Let’s talk a little about changes for employees. 

Is there much turnover in your unit? 

8. Are there career advancement opportunities at [this facility]? 

- Is there formal or informal progression from one position to another? 

^ ^ BEST COPY AVAILABLE 



Interview Questions for Nursing Supervisors 



Overview of CNA Position 

9. Now I'd like to focus specifically on the CNAs in your unit. What are the primary job 
responsibilities for CNAs in your unit? 

- Primary responsibilities would be the tasks that are performed most 
frequently and those that are most critical (The main job activities) 

10. What equipment and work aids do CNAs use? 

1 1 . Do you anticipate any new equipment being added to the unit in the future? 

- What? 

- When? 

- Will training be provided? 



Critical Workplace Basic Skills (communication, critical thinking, and mathematics) 

12. Thinking about the CNA job responsibilities, what are the most critical and frequently 
used listening skills? 

- Who do CNAs need to listen to? 

- When? 

- For what purpose? 

13. What are the most critical and frequently used speaking skills 0 

- Who do CNAs need to speak with? 

- When? 

- For what purpose? 

14. What are the most critical and frequently used reading skills? 

- When do CNAs in your unit need to read? 

- What are the types of materials that they need to read? 

[Ask for examples of materials.] 

- Safety signs? 

- Forms? 

- Notes? 

- Instructions? 

- Manuals? 
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Interview Questions for Nursing Supervisors 



15. What are the most critical and frequently used writing skills? 

- When do CNAs in your unit need to write information? 

- What type of writing do they need to do? 

[Ask for examples of materials.] 

r Forms? 

- Notes? 

''’-.-Charts? 

16. Whp are'flie most critical and frequently used critical thinking skills? 

Decision-making (e.g., evaluating and choosing the best alternatives? 

- Problem-solving (e.g., generating alternative solutions to a problem j? 

- Knowing how to learn (e.g., learning and remembering new facts or processes) . 

- Reasoning (e.g., applying policies to new situations)? 

- Creative thinking (e.g., suggesting new ideas, procedures or systems)? 

17. What are the most critical and frequently used mathematics skills? 

- Computing numbers? 

- Charting numbers? 

- Measuring? 



Workforce Education Program 

1 8. What do newly hired CNAs do best? Why? 



19. What do newly hired CNAs find the most difficult? Why? 



20. What type of basic skills training would be helpful for new CNAs? 

21. How do you see the Workforce Education Program benetitting your unit? 

- Improving communications or teamwork? 

- Improving reading, writing, or math skills? 

- Improving safety? 

- Improving quality? 

- Encouraging employees to problem solve? 

- Better equipping employees to deal with change? 

22. What potential barriers do you see for new CNAs taking part in this training. 



23. What suggestions do you have for this training? 

- about the content 

- about scheduling 

- for instructors 
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New Home Health Aide 
Job Task Analysis Interview 



Introduction 



Hello. 



f h«°cHH°?D “® r ; rm fr ° m Rockefeller Co Hege. We're interviewing people on the job for 
the Eddy/Rockefel.er for the Workforce Development Program for Home Health Aides The 

vnu 9 rn m Tl ad f dlt ' 0nal skil1 development beyond the the 75-hour training program that 

you completed. The information I gather today will help us develop learning experiences that 
will be useful (o HHAs as they work in Eddy Community Care. 



1 oday we II talk about your job and the skills you use on the job. I'll begin by asking some 
background questions to help me better understand your work. Then we'll talk about some 
specific skills required for your job such as observation, communication, making decisions, and 
solving problems that may come up. I'll be focusing on the tasks you have to do- I am not 
collecting information about your job performance. During the interview I will be taking notes 
but these notes and any specific comments you make will be kept confidential 



The interview should take about 45 minutes. 



Do you have any questions before we get started? 
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Background Information 



I'd like to start by getting some background information. 

1 . You have just completed training to be an HHA, is that right? 



2. Have you ever had the training before? 
- with The Eddy? 

~ with another agency? 



3. Have you held other jobs in the health care/medical field, with or without trainii 
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HHA Job 



Lot’s talk more specifically now about your job as an HHA. 

4. Thinking about what you do patient-to-patient and day-to-day. what are your primary icb 
responsibilities? y 



- What tasks do you do most frequently? 



- What tasks are most critical? 



- What tasks are most difficult? 



- What tasks are easiest or most enjoyable? 



- What tasks 




do you do the best? 
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5. How has the job matched 



your expectations so far? 



6. In what ways do you think of yourself as part of a team? 
- Are there particular situations? 

-Who do you think of as being on the team 



7. What do you think you would do if something goes wrong? 

A piece of equipment breaks down or functions improperly? 

- Someone before you did not do a thorough job? 

- You have disagreements with the client / with your nurse-supervisor? 

- Other situations? 
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Workplace Basic Skills (communication, critical thinking, and mathematics) 

Now I'd like to ask you about some specific skills you use while you're doing your job. 

8. When do you need to be observant as you are doing your job? 

- What/who do you need to observe? 

- For what reason? 



9. When do you need to listen on the job? 

- Who/what do you need to listen to? 

- For what reason? 



1 0. When do you speak on the job? 

- With whom do you speak? 

- For what reason? 
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1 1 . What reading do you need to do? 

- When do you need to read? 

- What types of materials do you need to read? 

- Forms? 

- Notes? 

- Instructions 7 
-Other? 



1 2. What writing do you need to do? 

- When do you need to write information? 

- What type of writing do you need to do? 

- Forms? 

- Notes? 

- Other? 



1 3. What mathematics do you need to do on the job? 

- Computing numbers? 

- Charting numbers? 

- Measuring? 

- Other? 



BEST COPY AVAILABLE 



v//-PAWL=FY33'.uOE"^SK-.HI-A!NTERGSl SAM 



297 



14. What critical thinking do you need to do on the job? 

- Decision making ( e.g . evaluating and choosing best alternatives)? 



- Problem solving (e g., developing alternative solutions to a problem)? 



- Learning (e.g., learning and remembering new facts or processes)? 
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Workforce Education Program (Give them Flyer 1) 



Finally, I’d like to ask you some questions that relate to the program we are 
for new HHAs. a 



developing 



15. 



Now that you've been out on the job, what type of training would be 
new HHAs? 



helpful for 



16. How do you see the Workforce Education Program benefiting HHAs 7 (Refer to 
Flyer 1) 

- Improving communication? 

- Improving reading, writing or math skills 

- Improving quality of work? 

Improving problem solving and independent decision making? 



17, Do you see any barriers for new HHAs to take part in this training? 



18. What suggestions do you have for this training? 

- about the content 

- about scheduling 

- for instructors 
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Closing: Thank you for your time today. Here is my card with my phone number. Please call if 
anything else comes to mind. May I have your phone number in case I need to follow up? 
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5 

c 

0 

E 

c 

03 

CO 

CO 
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o 

> 

03 

c 

03 

0 

c 

0 



CO 

< 

Z 

a 

t— 

£ 

c 

0 

E 

c 

03 

CO 

CO 

< 

=3 

O 

> 

03 

C 
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0 

C 

0 



CO 

< 

Z 

O 

t— 

£ 

c 

0 

E 

c 

03 

CO 

CO 

< 



o 

>- 

03 

c 

03 

0 

c 

0 



CO 

a 

o 

QC 

LU 

CL 

QC 

o 

CL 

LU 

OC 

g 

.j 

§ 

z 



CO 

-J 

< 

H 

O 

H 

LU 

< 

G 



o 

< 



O 

G 

Z 

LU 



co 

o 

< 

2 



O 

G 

Z 

LU 



£ 

< 

LU 

>- 



CO 

o 

< 



r-. 

o 

< 



00 

o 

< 



1- 




CM 


a 




a 


< 




< 


in 




in 


>■ 




>■ 



317 318 







































— - 






























































































































MA09 




MA10 




MA1 1 




MAI 2 




MAI 3 




MAM 
























. 







o 

o? 

CO 



CD 

v~H 

CO 







# 

Training Hours 


6x 3 = 18 




6x 3 = 18 




6 x 3 = 18 




TOTAL HOURS: 
54 CNAs 


0 HHAs 






















# of Learners 


6 CNAs 




6 CNAs 




6 CNAs 




TOTAL: 

18 CNAs 


_0 HHAs 






















Trainer 


Negri 

Katchmar 




Negri 

Katchmar 




Negri 


























RVISORS 

Location 


Eddy Cohoes 




Eddy Memorial 
Geriatric Center 




Heritage House 


















1 








UR SUPE 
Date 


5/21/96 




5/29/96 






6/11/96 


























UNICATING WITH YO 
Title 


Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




CO 

—1 

2 

o 

1- 

UJ 

1- 

< 

Q 


Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




Communicating with your 
Supervisors 




COMM 

Code 


CS01 




CS02 




CS03 




YEAR TO 


CS04 




CS05 




CS06 




CS07 




CS08 






YEAR 2 



































c\> 
o > 
CO 



C\» 

CO 



cv 

co 




3 

o 

> 



o 

> 



O) 

c 



CO (/> 
O ' 



c 

3 

E 
E 

o _ 

O C/5 



CO (/> 

- o 

i i 

E Q 
O D 
O C / ) 




C/5 

O 



o 

T— 

CO 

o 



co 

c\> 

oo 



o 

ERLC 






Training Hours 


3x2 = 6 




TOTAL HOURS: 
6 CNAs 


0 HHAs 


8 x 3 = 24 




6x3 = 18 




6x3 = 18 




TOTAL HOURS: 
66 CNAs 


0 HHAs 
















# of Learners 


3 CNAs 




TOTAL: 

3 CNAs 


_0 HHAs 


8 CNAs 




6 CNAs 




6 CNAs 




TOTAL: 

_23 CNAs 
_0 HHAs 
















Trainer 


Medina 

Hall 






Negri 

Katchmar 




Negri 

Katchmar 




Negri 

Katchmar 




















WORKERS 

Location 


Eddy Memorial 
Geriatric Center 






Eddy Cohoes 




Eddy Memorial 
Geriatric Center 




Heritage House 




















OUR CO-l 
Date 


1/25/96 






5/13, 15/96 




5/17/96 




5/31/96 




















UNICATING WITH Y 
Title 


Cmmunicating With Your 
Co-Workers 




NWLIS REPORT PERIOD 3 


Communicating With Your 
Co-Workers 




Communicating With Your 
Co-Workers 




Communicating With Your 
Co-Workers 




DATE TOTALS 


Communicating With Your 
Co-Workers 




Communicating With Your 
Co-Workers 




Communicating With Your 
Co-Workers 




Communicating With Your 
Co-Workers 


COMM 

Code 


CW01 




END OF 


CW02 




CW03 

— 




CW04 




YEAR TO 


CW05 




CW06 




CW07 




CW08 




CM 

GC 

< 

111 

>■ 



































CD 

CM 

CO 



LO 

CM 

CO 



GO 

Cv? 

00 



O) 

c 

CO </> 

y & 

c 

II 

o o 
O O 



O) 

c 



03 (/> 

.y 55 

c ^ 

II 

o o 
O O 



O 



$ 

o 



r- 

CV 

00 




BEING NEW 

Code Title Date Location Trainer # of Learners Training Hours 




CD 

II 

CO 

X 

CM 




3x3 = 9 




05 

II 

CO 

X 

CO 




TOTAL HOURS: 
24 CNAs 


0 HHAs 


CM 

II 

CO 

X 

CO 




CO 

II 

CO 

X 

CD 




6x3 = 18 




TOTAL HOURS: 
84 CNAs 


0 HHAs 










3 CNAs 




3 CNAs 




3 CNAs 




TOTAL: 

9 CNAs 


_0 HHAs 


8 CNAs 




6 CNAs 




c/5 

< 

Z 

o 

CD 




TOTAL: 

_29 CNAs 
_0 HHAs 




i 

I 






Medina 

Hall 




Katchmar 




Hall 






Negri 

Katchmar 




Negri 

Katchmar 




Katchmar 

Negri 




\ 

1 










Eddy Memorial 
Geriatric Center 




Heritage House 




Heritage House 






Eddy Cohoes 




Eddy Memorial 
Geritaric Center 




Heritage House 














1/25/96 




3/13, 15/96 




3/22/96 






5/7, 8/96 




5/16/96 




5/31/96 














Being New 




Being New 




Being New 




NWLIS REPORT PERIOD 3 


Being New 




Being New 




Being New 




DATE TOTALS 


Being New 




Being New 




BN01 




BN02 




BN03 




END OF 


BN04 




BN05 




BN06 




YEAR TO 


BN07 




BN08 




YEAR 2 
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BN09 Being New 







^=H 

CO 

CO 



332 







Training Hours 


8 x 3 = 24 




6x 3 = 18 




00 

II 

CO 

X 

CO 




TOTAL HOURS: 
60 CNAs 


0 HHAs 






















# of Learners 


8 CNAs 




6 CNAs 




6 CNAs 




TOTAL: 

20 CNAs 
__0 HHAs 






















Trainer 


Negri 




Negri 




Negri 


























R CLIENTS 
Location 


Eddy Cohoes 




Eddy Memorial 
Geriatric Center 




Heritage House 


I 
























ING YOUF 
Date 


5/23/96 




6/10/96 




6/11/96 


























sIG AND UNDERSTAND 
Title 


Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




DATE TOTALS 


Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




Knowing and Understanding your 
Clients 




KNOWIt 

Code 


KC01 




KC02 




KC03 




YEAR TO 


KC04 




KC05 




CO 

o 

O 




KC07 




KC08 






YEAR 2 



































oo 

CO 



CO 

CO 

CO 



CD 

CO 

CO 




13 

o 

> 

o> 

c 

T3 

C 

3 

o 5 

a) 

T 3 

C 

3 



13 

O 

> 

O) 

c 

T3 

C 

is 

o 5 

*T 3 

c 

3 



T 3 

C 

(D 

O) 

.9 a 
$ c 
O 0 ) 

5 U 



T 3 

C 

(D 

O) 

C </> 
I C 

O a) 

5 U 




CD 

O 



U 

* 



u 



Lf5 

OO 

CO 




Learning Strategies 

Self-Assessment 



Name 



AW , 



SS/ID #: 



ipjE POST 



Date: __i _ 

Location: IL 



1 On the following scale, rate yourself as a learner. 

, 2 3 -1 

} I have a strong sense 

I lack self-confidence of myself as a 

as a learner. competent learner. 




2 . 



On the following scale, rate your 



readiness for this training. 



I am not sure if I am 
ready for this training. 



5 

I am confident that I 
am fully prepared for 
this training. 



3 On the following scale, rate your ability to take notes when someone is giving a lecture: 



1 

I do not have ideas for 
taking effective notes 
during a lecture. 



I know how to take 
notes effectively 
during a lecture. 




4. On the following scale, rate your ability to skim material before you 




I am unsure of the 
way to skim material 
before I read it to get 
the big picture. 



read it. 



5 

I know the way to 
skim material before l 
read it to get the big 
picture. 

lOveO 
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Name 

Date 



Getting the Most Out of Your Training 



Preparing Myself Always 

1. Do I arrange for my family's needs? j 

2. Am I rested before going to class? j 

3. Do I eat adequately? j 

4. Do I go prepared to listen? j 

5. Am I on time? J 

6. Do I let myself relax so I can listen or study? □ 

7. Do I acknowledge that it's okay to be tired or □ 

discouraged at times? 

8. Do I believe I will learn? □ 

9. Do I engage in positive self-talk? J 

10. Have I set up work space that is comfortable and □ 

large enough for study? 

Explain any "no" answers below: 




Preparing for Class Always 

11. Do I check the training outline before class? J 

12. Do I think about the topic and what I might know J 

about it? 

13. Do I think about how the information will be used on J 
the job? 

14. Do I write down questions I have so I can get the □ 

information I need? 

15. Do I discuss materials with others? □ 

16. Do I practice the skills on my own? □ 

Explain any "no" answers below: 



Most of 
the Time 

□ 

□ 

□ 

J 

J 

□ 

J 

J 

J 

□ 



Most of 
the Time 

□ 

J 

J 

J 

□ 

□ 



Sometimes Never 



J J 

J J 

J J 



J j 

J J 

J J 

J _ j 



J J 

□ _i 

□ J 



Sometimes Never 



□ 

J 

□ 

□ 

J 

J 



j 
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While Taking Notes 



Always 



17. Do I write down what I think is important? □ 

18. Do I identify key topics and terms? □ 

19. Do I reword materials into terms I can remember? □ 

20. Do I relate new materials to my own knowledge? □ 

21. Do I use my "shorthand" to make note taking easier? O 

Explain any "no" answers below: 



Most of 
the Time 

□ 

□ 

□ 

□ 

□ 



Sometimes Never 



□ □ 

□ □ 

□ □ 

□ □ 

□ □ 



After Taking Notes 



Always Most of Sometimes Never 
the Time 



22. Do I recopy or organize notes so they make sense? 

23. Do I highlight vocabulary words and definitions? 

24. Do I review notes soon after a lecture? 

Explain any "no" answers below: 



□ 

□ 

□ 



□ 

□ 

□ 



□ □ 

□ □ 

□ □ 



For Testing 

25. Do I keep up with classwork so I am prepared for 
tests? 

26. Do I practice my skills so I am prepared for testing? 

27. Do I know what I need to study and practice? 

28. Do I help myself relax before and during a test? 

29. Do I skim the whole test before answering? 

30. Do I read all directions before answering? 

31. Do I practice smart guessing? 

32. Do I leave time for review? 

Explain any "no" answers below: 



Always Most of Sometimes Never 
the Time 



□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 



□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 



□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 



J 

J 

J 

J 

□ 

□ 

J 

J 
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Getting tjie Most from Skill Development 



Before Reading 


Always 


Most of 
the Time 


Sometimes 


Never 


33. Do 1 take time to skim materials before reading? 


□ 


□ 


□ 


□ 


34. Do 1 look for titles, sections, and organization? 


□ 


□ 


□ 


□ 


35. Do 1 read underlined, italicized, and bolded words'? 


□ 


□ 


□ 


□ 


36. Do 1 look for definitions? 


□ 


□ 


□ 


□ 


37. Do 1 read first and last paragraphs? 
Explain any "no" answers below: 


□ 


□ 


□ 


□ 



While Reading 


Always 


Most of 
the Time 


Sometimes 


Never 


38. Do 1 take notes or highlight? 


□ 


□ 


□ 


□ 


39. Do 1 read material in charts, diagrams, and boxes? 


□ 


□ 


□ 


□ 


40. Do 1 read and answer summary questions? 
Explain any "no" answers below: 


□ 


□ 


□ 


□ 



While Questioning 


Always 


Most of 
the Time 


Sometimes 


Never 


41. Do 1 write down questions 1 have while I'm reading? 


□ 


□ 


□ 


□ 


42. Do 1 ask questions that 1 need answered? 


□ 


□ 


□ 


□ 


43. Do 1 ask closed questions to get specific information? 


□ 


□ 


□ 


□ 


44. Do 1 ask open questions to get additional inormation? 
Explain any "no" answers below: 


□ 


□ 


□ 


□ 



During Lectures 


Always 


Most of 
the Time 


Sometimes 


Never 


45. Do 1 take notes on the lectures and handouts? 


□ 


□ 


□ 


J 


46. Do 1 label my notes: date, topic, speaker's name? 


□ 


□ 


□ 


■J 


47. Do 1 use categories to help organize the material? 


□ 


□ 


□ 


□ 


48. Do 1 listen for clues as to what’s important? 


□ 


□ 


□ 


□ 


49. Do 1 pay attention to body language? 


□ 


□ 


□ 


J 


50. Do 1 highlight what the instructor says is important? 


□ 


□ 


□ 


J 



Explain any "no" answers below: 
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51 . Have I been able to keep up with class work? q — j 

If not, why not? 

52. Have I been able to use the Learning Strategies in the training? j j 

If not, why not? 

53. Have I been able to manage my time between training and home? j j 

If not, why not? 

54. Do I expect to complete the training? j j 

If not, why not? 

55. Have my ideas about the job changed? j j 

If yes, explain. 

56. Do I anticipate barriers to performing the job of Home Health Aide? j j 

If yes, explain. 
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Module 2: Understanding Your Assignment Sheet 
Learner Assessment 

ss # 

Date: Dec, uiqqu 

p Location: EOOCaiL 

Directions: Write the meaning of the following abbreviations in the space provided. 

1 

2. ADLs UbJLD Qfr ftculif JUrtury 

3 rom ^JhnCj/ /OA i imtoxx on _ 

4. SRx2 ±\lJCLp 71 Cli S /D V S *** ^ ^ 

5. OOB AQjjJl QQ . 



PRE 

POST V 




^0 

o. 

— Q 



Part B. 

Dire&jgns: List two strategies that new nursing assistants can use to team the meaning of 
job-related abbreviations. 

1 QloYz yo ^vri o jCutho 

2 . mpjrnGAjuy 



Part C. 

Directions: Rewrite the following directions from an assignment sheet using non-medical words. 
Write the directions as full statements that clearly describe the care that you need to provide for 
the resident. Include the phrases 'I need to' and this resident • in each statement. 



Example: 

x. Shower Thurs 7-3 

Translation": / need tQ o/Ve th/s resident a shower on Thursdays during the, hi shift 



1 . toilet q 2 hrs. 



MW 



jQ 4-Ki 

2 . PROM LLE x5 q am 

I need to plQttuU forty l>^j- Ifl/UM ^Mjg wk 

3. A1 S/P Super , VYJO WiA 

I need to OLOOlQi' j&M tVu» r&ihmf ~b fvfa/y i +- pi\£t- s - 

J wj wsiA 

Rockefeller dtneqe 

34 2 
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SUNY Albany 



Wka t Your Assignment Skeet Really Says 



Pre / Post Test 






1. Write the meening of the following abbreviations: 




f. @HS 

g. OOB 

h. NPO 

i. PRN 



-0 =4h 






2. List three strategies for learning the meaning of job-related 



JL\SlJ^lcO 






abbreviations. 



BEST COPY AVAILABLE 



34 3 
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Pre Post Test; Wkat T[ our Assignmeat Skeet Really Says 



2 



3. Rewrite the following directions from an assignment sheet using non-medical words. 

Write the directions as full statements that clearly tell how to provide care for the resident. 
Use the words "this resident' in each statement. 

a. toilet q 2 hrs. 

I need to 



b. PROM LLE x5 q am 

I need to 



c. Feeding: Set*up. Plateguard 

I need to 



d. Treatments: Bil. Hand rolls 10 pm-6 am 

I need to -jjs X/- t-tQ 



e. Shower Thurs 7-3 

I need to 
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Name 

SS# 



/ V <- / 

~QSH ~ » 



STRESS ON THE FLOOR 



Pre/Post 



D i rections: Fill in True or False (T or F) on the blank line provided opposite the question. 



1 . Stress is an emotional response to an event 

2. Stress levels are related to the amount of stressors that 
people experience 

3. Stressors may be positive or negative 

4. A sign of stress is to lose oxygen 

5. The body reacts to stress by calling on its immune system 

6. An example of aggressive behavior is to "take flight" 

7. A source of strength in stressful situations is due to 
increased adrenaline to the body 

8. In stressful situations, sugar in the body increases 

9. Stressors are events that cause stress 

10. Positive self-talk emphasizes "shoulds" for example, 

”1 should do this" 




Fill in the blanks with the correct answer(s): 



Two examples of stress management techniques are T. LBJ-t, ~/r3 Sd/Wf Qnli 



2 . 

Two specific stress reduction techniques that you can use in the workplace are 

3 zt/dJL -Ad Co - u L a ./- !r 

Stress is a 5. & P pp p 0 f the body. 

Two "defense mechanisms" for dealing with stress are 6. P~ / ; L "•/- 



z^EL^_kd=. 



Stress has both a 8. ^ K ^ 

and 9j_ pU 

on most people. 



or 



effect 



Name one negative result of stress in the workplace - in 7^ 



BEST COPY AVAILABLE 
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Module 4: Knowing & Understanding Your Residents 
Learner Assessment 

SS# / %/' - 



PRE 



Date: 
Location: 



'J' /V- 96 




Directions: Fill in the Blank with the correct answer(s): 

Name two things that a resident gives up when they enter residential care 1 . /y? r \ tf — 

and 2. . 

Two common resident behaviors are 3 fnnr\ly,-hva and 




ft irnuM-' 



Two possible reasons for the behaviors that you just described are 5. fY\P/rt4&J. 

and 6. fll£d±£&J_ . 

Three techniques to deal with difficult resident behaviors are 7. 4f3lK Ai^c-irl -ftp Ajl q \ cLs.un'^' 

8. AjU^p jjQiC£ )QU>^ and 9. H 5 kp 

Maslow’s Theory explains 10. /Aiory a / /HuAl 

Directions: Fill in True or False (T or F) on the blank line provided opposite the question: 

1 . A residents family and/or friends are most likely to notice 
and report changes in the resident. 






2. Prior patient information is not important for new NATs 

3. Objective observations are based on feelings and opinions 

4. Behavioral changes in a resident may indicate a new 
medical situation 

5. A resident’s room may make a non-verbal statement about the 

residents life, family, and personality 

6. A subjective observation reports facts 

7. NATs and CNA’s have a responsibility to maintain 
resident confidentiality 

8. For the sake of time, we should discourage residents from 
"doing for themselves" 

9. Housekeeping and custodial staff are the only people responsible 
for resident safety 

10. Skilled observations require utilizing all of your senses 

346 






T 



£_ 



Z 



£. 
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Module 5: Handling the Stress of the Floor 
Learner Assessment 



PRE 



ss # 

Date: 







Location: 



12. 'J_ 2 -J_ L 



A. Directions: Fill in True or False (T or F) on the blank line opposite the question. 



1 . Stress is an emotional response to an event. 



T - 



2. Stress levels are related to the number of stressors that 
people experience. 



3. Stressors may be positive or negative. 

4. A sign of stress is to lose oxygen. 

5. The body reacts to stress by calling on its immune system. 

6. An example of aggressive behavior is to "take flight." 







F 



£ 



7. A source of strength in stressful situations is due to 
increased adrenaline to the body. 






8. In stressful situations, sugar in the body increases. 

9. Stressors are events that cause stress. 



-*/ 



10. Positive self-talk emphasizes "shoulds," for example, 
"I should do this." 



F 3 



B. Directions: Fill in the blanks with the correct answer(s): 

Two examples of stress management techniques are 11. Off 

12 i , skn-h 

Two specific stress reduction techniques that you can use in the workplace are 

13. and 14 i £ i- Q \a 



and 



Stress is a 15. 






of the body. 



Two "defense mechanisms" for dealing with stress are 16. ^ 

1 Z liWfeku a, >A\ 





-3 



1 



or 



Stress has both a 18. 
on most people. 



£ 






and 19. 






effect 



Name one negative result of stress in the workplace - 2SL 



347 
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Cl IfUV A 



Handling the Stress of the Floor 
Learner Assessment 



ss# _ 

Date: 

Location: 




A. Directions: Fill in True or False (T or F) on the blank line opposite the question. 



Stress is an emotional response to an event. 

Stress levels are related to the number of stressors that 
people experience. 

Stressors may be positive or negative. 

A sign of stress is to lose oxygen. 

Members of helping professions experience increased stress. 

An example of aggressive behavior is to "take flight." 

A source of strength in stressful situations is due to 
increased adrenaline to the body. 

In stressful situations, sugar in the body increases. 

Stressors are events that cause stress. 

Positive self-talk is not a good stress reduction technique. 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 




i 



10 . 



0 



B. Directions: Fill in the blanks with the correct answer(s): 



Two examples of personal stress management techniques are 11. " 

12. ■ . v L_ . Two specific stress reduction techniques that you can use 

in the workplace are 13. - ' { and 14. 



and 



Stress is a IS. 



dealing with stress are )4. 

Stress has both a 18. • • < 



-/ 



the body Two "defense mechanisms" for 
or \T. 



f 



and 19. 



effect 



on most people. Name one thing that can happen in the workplace if people can't handle their 
stress 20. . . ,. - • ' 
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Rockefeller College 
SUNY Albany 



Communicating Effectively on the Floor 
Learner Assessment 



ss# 

Date: • 

Location: 






PRE 

POST 






I _ 

’-U- ' 



^ C 




Fill in the Blanks: 

Basic communication requires three components. They are: 1. Q> ^ 



2 . 



and 3. 1^: 




Two personal barriers to effective communication are 8. ‘ ,-is~ and 

9. 'k2> . 




O 

ERJC 



Research shows that most people communicate using 10. 



True/False 



1 . Reading is the most common method of absorbing information. 

2. Listening is a passive skill. 

3. Body language is not important in the communication process 
as long as we speak clearly. 

4 . Listening and hearing are the same skill. 

5. Perceptions have consequences. 

6. A closed question is a complex question. 

7. An open question asks for specific information. 

8. Poor communication does not contribute to conflict since conflict 
involves emotions. 




9. Communicating a professional image is not the responsibility of 
aCNA. 




10. True customer service involves every member of the residential 
facility including telephone operators. 
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Rockefeller C-Mege 
SUNY Aibary 



. . c\ COMMUNICATING EFFECTIVELY 
Name ) ON THE FLOOR 

SS# dfcAf, w v/ 




Pr^ost 

Fill in the Blanks: 

Basic communication requires three components. They are: 1. AlmAjJI L 

t 

2. and 3. 

Two purposes of communication are to 4. ULjltdjMdJZdxl 

5 . JjLjU. 

Two general barriers to effective communication are 6. iiJjyjttd J 

MtL ±UULUUnAMi i^ y 



and 



and 7; 

Two personal barriers to effective comrpunication are 8i 

a 



and 



/ 



Research shows that most people communicate using 



ing 10, CjijjdlAJi l 



True/False 

1 . Reading is the most common method of absorbing information 

2. Listening is a passive skill 

3. Body language is not important in the communication process 
as long as we speak clearly 

4. Listening and hearing are the same skill 

5. Perceptions have consequences 

6. A closed question is a complex question 

7. An open question asks for specific information 

8. Poor communication does not contribute to conflict since conflict 
involves emotions 

9. Communicating a professional image is not the responsibility of 
a CNA 

10. True customer service involves every member of the residential 
facility including telephone operators 



P 

T 

_L 
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antf Letting Go of stress 3 T ' me 



J^rroripservice 

Soc. Sec. 2 _ L ^X^ssessment 



Date 



■H2j C sjn&_ 






Complete bed bath 
Shampoo 
Comb/brush 
Clean figemails/toenails 
Routine mouth care 
/L Toilet/commode 
Dress client 



Bed to chair: pivot transfer 

^z:::T eseep -'^^ 

1 An 6 ? Cli6nt aSSiSt as need ed 
3 Jes?™*™* 3pply ankle br ™ a»er 

The Aide is to complete her test, „ 5^ Speaal ski h «re: keep client dean ana Pry 

toetesks" 6 with the client, and then' ^e^h* 1 N^he < ^e has onlyThour to do** 

a * w hat should the Aidedo first? Why? 

■ Et-tS i A^pcVtuvtr Wok- At^r 

t What »ould she need to do next? Why? ^ S '-^" r ' (*, r, c n~A. 

~ T '° ; Wfr- l 

° C^€-»w^§ rf^-cV t'VT r 

«M being 3 , oe 1 ^“mtde^ 5° ^'^POrtanc, p lease Oo the mos , jmportant 



3. 






5. 



5. 



Write a work-related goal that you have. 

Write atteast one work-rlliSd objeSive ^ c n i[[ 

' G-, 



- -vc r ^ ^ 



J/Vhat does competing alternatives" mean to you? 

* ^ VK '^ ,1- e "Sftw.l pczs.-C.I, 

What is block time? 



-S to 4 — V- \ ^ 

n. I ( , (J , v -4— / TStoc Jc.u \ 

CAcvtUs j , V'J 

^ H-l/VVy.- J . 

^ < Cr'rupu^ . | 

cJe-f- „ Yr . r j 



O 

uc 



■a 
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7 . What are three common time wasters? 




c ■KCry ( ccv t i Z f < i 



8. What is a to-do list? How does someone use one? 



prt cTv i-t 2_^ 4--K*> 



L-KV— (— o b -& eFHr C /-IW 7 



,_r Vve 1 1 

cTtler £&r {- 



Please read the following situation and then answer the questions: 

Mr. Alvarez is a 41-year-old man who was born in Cuba. When he was 26 years old, he left Cuba to 
move to this country illegally. In Cuba he was a school teacher, but he could not get a job teaching in the 
United States. Being a very active man with limited English, he took many different jobs that all required 
a lot of mobility. Six years ago he was diagnosed with diabetes, but that didn't slow him down a bit. In 
fact, he was doing very well— until three years ago when he was diagnosed with MS. From that day till 
now, he has not worked. 

Mr. Alvarez would like very much to see his family. They cannot come to the United States, though, and 
he cannot travel to see them. He has spent all his savings and is living on financial help from the 
Department of Social Services in a run-down neighborhood under an overpass. He has very few people 
around that he wants to spend time with and is thankful to have his elderly cat (who has become 
incontinent). 

Recently Mr.. Alvarez was told that he has developed some circulatory problems because he had not 
been caring for himself property. The doctor is concerned that Mr. Alvarez might need to leave his own 
place and move into a nursing home. 

9. Based on the situation above, list three possible stressors that a new Aide should be aware of: 



b. jcx*Aorvei. rw t4r^l4iv. 




10. How do you know when you are experiencing stress? 



v- poswloty L-C'S^ 



*t *1-7$ OcJr- 



1 1 . Wnat are three symptoms of stress? 

3- W-C c<^ i'u U.f' 
b. p^eiSp^r# 





12. What is one method for relieving stress? 
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Controlling Time to Complete the Care Plan 

Answer all questions based on your home care knowledge and training. 

Write a T if the statement is true, an F if it is false. 

. 1 . Spending time deciding on goals, objectives and priorities is just using time up. 

. 2. Time can be controlled by looking at objectives and setting priorities. 

3. People in home care don't really need to think about the way they spend their time. 

4. Scheduling time only needs to be done by people who are very busy and important. 
^ Home Health Aides can never complete all they have to do each day. 

6. Blocking time doesn’t help most aides to see how they spend their time. 

7. Block time creates schedules. 

8. Schedules for client care tell you how long activities take. 

9. Schedules are based on the time people expect activities to take. 

10. The way home health aides use time affects job satisfaction. 



II. 

11 . 



Fill in the blanks. 

According to the module, three common time wasters on the job are: 



(b.) 

(c.) 






4 r rg r t~ 



12. The steps for using a "To-Do" list are: 

(a.) jrh^LQCi Q£-C_ C-L ne 

(b.) VjoVa s^Ar- v\-o dr, 

(P-f n <-| O A i -V- h 

id.) vki rV- 'W 1 F 

(e.) 

(f.) 
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UNIT: Care Planning and Goal Setting with Your Home Care Client 
Module 2: Controlling Time to Complete the Care Plan pre Y- 

Learner Assessment _ P0ST 

ss# S^a 'SI £ ~7 .rj? 

Date //-<?Z~ 4* 

Location: OZsm . 



Part A. 

Directions : Write a (T) if the statement is true, an (F) if it is false. 




1 . Spending time deciding on goals, objectives and priorities is just using time up, 

2. Time can be controlled by looking at objectives and setting priorities, 

3. People in home care don’t really need to think about the way they spend their time. 

4. Scheduling time only needs to be done by people who are very busy and important. 

5. Home Health Aides can never complete all they have to do each day. 

6. Blocking time doesn't help most aides to see how they spend their time. 

7. Block time creates schedules. 

8. Schedules for client care tell you how long activities take. 

9. Schedules are based on the time people expect activities to take. 

10. The way home health aides use time affects job satisfaction. 



Part B. 

Directions: Fill in the blanks. 



1 1 . According to the module, three common time wasters on the job are: 

m s. 

(b.) rto-f prt'br/f?*/'^ 



12. The steps for using a "To-Do" list are: 

(a.) ZtMr f^rrrl 1 

(b.) p&f tTr-tccyJf - X rx rZT 

(c.) 

(d.) 

(e.) 

(f.) 
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UNIT: Care Planning and Goal Setting with Your Home Care Client 

O' I ~ r m 



Module 3: Letting Go of Stress 
Learner Assessment 



Part A. 

Directions : Circle the letter of the correct answer. 



ss# T> jhgq 

Date: _//. ^,0 - _ 

Location:, ^ , 



pre _y_ 

POST 



1 • Stress 

a. is not important to most people 
d. doesn't affect most people 



Stress 

a. is caused by negative event 
c. is tension one feels. 



3. Stress symptoms: 
a. are physical. 

^all of the above 

Part B. 

Directions : Fill in the blanks. 




can be ignored, c. is only important for a short time. 
\^)s a major part of everyone's life. 



b. is caused by positive events, 
of the above d. none of the above 



b. are psychological, 
e. none of the above 



c. are unique to each one of us. 



4. 



Four steps that can help you reduce stress in a home care setting are 

(a-) -fe n'erht* ( C .) . assess 

(b.)_bt ■Srley.Tbfc td.) -fzifc -fAeir* 

“ , J 



5 . 






(d ) T 



6. 



Four common symptoms of stress in client care are 

(a)-Lcd baeC-d — &££&£& (c.) 5 c/e. £ ✓ <sM_ 

(b.) fyv Of 

\S-OtC£ ” 

The four categories of stressors are 

(a.) j ✓) -*-/ 

(b.) uuL 



(C.) 

(d.) 



pAg Sj-C4 



L 



yh ey r ^ A,/ 



7. 



Four reasons people use to put off doing things are 

(a ) cjgydV" Uf (<.+*.'& Tib Ao uf . (C.) Yl /vi W 

(b.) L h — IS/rf (d.) 







Name one relaxation technique you can use in the home care setting: 

rust- t 7 /g/YwCy CfO 
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Setting Priorities for Client Care 

Answer all questions based on your home care Knowledge and training. 

1. Circle the letter before the correct answer for each of the following. 

(_ "Goals" are 

what you hope to do. b. the ends you intend to achieve. c. your dreams. 

^j a H a ^° ve e none of the above 

2. The word "objectives" means ^ 

a. not taking sides in an argument. Vb. the steps to help you achieve your goal 
c. disagreeing with another person's beliefs^ d. all of the above. e. none of the above 

3- ' "Client goals" are 

a. what you expect a clientto do. b. what you expect to be able to do with a client, 
c. activities. d^/all of the above e. none of the above. 

4. "Priorities" in the home care setting are 

a. the time spent on activities v b. important tasks that need completion, 
c. whatever you like to do. d. all of the above e. none of the above 



5. "Setting priorities" in your life and for client care means 

a. thinking about your objectives and doing tasks to help you achieve them. 

b. thinking about the importance of tasks-and putting them in order. c. writing necessary 

tasks down to keep you focused. ^ d. altpf the above e. none of the above 

6. "Competing alternatives" are 

a. choices b. equally important choices c. activities that compete for time and energy 
that you need to choose between d. all of the above e. none of the above 

7. "Ranking" tasks to complete the Care Plan means , 

a. activities you have to do that you think are disgusting 'V b Jputting tasks in order of 
importance c. deciding which tasks you would lik^rdo on the job. 

d. all of the above e. none of the above 

"Personal objectives" are 

a. not relevant to work situations. b. only relevant to relationships. c. important 

to keep you focused on what you need to do. d. all of the above e. none of the 

above 



II. Fill in the blanks. 

9C Effective objectives to help you with client care must be (List four qualities) 

(a.) £ f~ p'-; ■' '• , (c.) Jj_i: ' n 

(b.) thill rv~t _u •• _izr ; / , (d.) r ' 

10. "Categorizing priorities" means r '!. . r ■ , rv ^ l 1 






I L 



Name l \i: 



/ /. 






A t /N 

I. D. # %\ Cl 



Date 
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v j\oU- - 



Dealing With the Stress of the Home Care Setting 

Answer all questions based on your home care knowledge and training. 

Circle the letter of the correct answer. 

Stress 

a. is not important to most people tx can be ignored, c. is only important for a short time, 

d. doesn't affect most people e.fs a major part of everyone's life. 

Stress 

a. is caused by negative events. •. b. is caused by positive events. 

c. is tension one feels. . d. all of the above d. none of the above 



Stress symptoms: 



■ft 



are physical. 



d. aJI of the above 



b. are psychological, 
e. none of the above 



c. are unique to each one of us. 



II. 

4. 



Fill in the blanks. 

Four steps that can help you reduce stress in a home care setting are 



(ar fCLUi^' 1 ' h: 

M ' 



) / 



£■) JZH 

ftT & 



> o v . o.r.y 



do 



; f 



5. Four common symptoms of stress in client care are 



flf) Lock 



V.y 



(bo InSTm it-'.ro 



Jr 



(d.) 



- ! O.J 

-:V' ! G -C"-- 



Jjci- 



6. The four categories of stressors are 

(a.) ~]7':b SVf5 5 (c.). 

(b.) hxi £Dl lj\ 5 2 . (d.) 









7. Four reasons people use to put off doing things are 

(a.) Urv-- ■ £ '.'C'yJ — - ~ (c. 

— - : ■ (d.) 



(b.)^_Cl 



8. Name one relaxation technique you can use in the home care setting: 

‘ ni>vj4hr,y, 



ERIC 



t 
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Setting Priorities for Client Care 

Answer all questions based on your home care knowledge and training. 

I. Circle the letter before the correct answer for each of the following. 

1. "Goals" are 

a. what you hope to do. b. the ends you intend to achieve. c. your dreams, 

d. all of the above e. none of the above 

2. The word "objectives” means 

a. not taking sides in an argument. b. the steps to help you achieve your goal, 
c. disagreeing with another person’s beliefs. d. all of the above. e. none of the above 

3. "Client goals" are 

a. what you expect a client to do. b. what you expect to be able to do with a client, 
c. activities. d. all of the above e. none of the above. 

4. "Priorities" in the home care setting are 

a. the time spent on activities tr important tasks that need completion. 

c. whatever you like to do. d. all of the above e. none of the above 

5. "Setting priorities" in your life and for client care means 

a. thinking about your objectives and doing tasks to help you achieve them. 

b. thinking about the importance of tasks and putting them in order. c. writing necessary 
tasks down to keep you focused. ( d. all of the above e. none of the above 

6. "Competing alternatives" are 

a. choices b. equally important choices c. activities that compete for time and energy 
that you need to choose between d all of the above e. none of the above 

7. "Ranking" tasks to complete the Care Plan means 

a. activities you have to do that you think are disgusting b. putting tasks in order of 

importance c. deciding which tasks you would like to do on the job. 

d. all of the above e. none of the above 

8. "Personal objectives" are 

.a. not relevant to work situations. b. only relevant to relationships. c. important 

to keep you focused on what you need to do. d. all of the above e. none of the 

above 



Date 



rre / rosi 



Name 
I. D. # 



II. Fill in the blanks. 

9. Effective objectives to help you with client care must be (List four qualities) 

(a ) (c.) 

(b.) (d.) 

10. "Categorizing priorities" means 
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UNIT. Care Planning and Goal Setting with Your Home Care Client 
Module 1 : Setting Priorities for Client Care PRE 

Learner Assessment 

ss# 

Date: 




Location: 



Part A. 

Directions: Circle the letter before the correct answer for each of the following. 



1 . 



6 . 



"Goals" are 

a. what you hope to do. 
© all of the above 



b. the ends you intend to achieve, 
e. none of the above 



c. your dreams. 



The word "objectives" means 

a. not taking sides in an argument. ^?the steps to help you achieve your goal 
c. disagreeing with another person’s beliefs. d. all of the above. e. none of the above 

"Client goals" are 

£?wha, you expect a client to do. b. what you expect to be able to do with a client, 

c. activities. d. all of the above ^Pnone of the above. 



"Priorities” in the home care setting are 

@ the time spent on activities b. important tasks that need completion. 

c. whatever you like to do. d. all of the above e. none of the above 

"Setting priorities" in your life and for client care means 

a. thinking about your objectives and doing tasks to help you achieve them. 

b. thinking about the importance of tasks and putting them in order. c. writing necessary 

tasks down to keep you focused. (d) all of the above e. none of the above 

"Competing alternatives" are 

a. choices (1£> equally important choices c. activities that compete for time and energy 
that you need to choose between d. all of the above e. none of the above 

"Ranking" tasks to complete the Care Plan means 

a. activities you have to do that you think are disgusting putting tasks in order of 

importance c. deciding which tasks you would like to do on the job. 

d. all of the above e. none of the above 



8. "Personal objectives" are 

a. not relevant to work situations. b. only relevant to relationships, 
to keep you focused on what you need to do. all of the above 

above 

Part B. 

Directions: Fill in the blanks. 



c. important 
e. none of the 



10 . 



Effective objectives to help you with client care must be 

( a ) (c.) 

(*>•) (d.) _ 



(List four qualities) 



"Categorizing priorities" means • 
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Care Planning and Goal 
Dealing With the Stress 
Learner Assessment 



Setting with Your Home Care Client 3: 
of the Home Care Setting 






POST 



30 

Part A. 

Directions: Circle the letter of the correct answer. 



ss# o2!±hQi23k2> 

Date: S-17-C\7 

Location: £cr 



1 . 



2 . 



3. 



Stress 

a. is not important to most people 
d. doesn't affect most people 



b^can be ignored, c. is only important for a short time 
(eNs a major part of everyone's life. 



Stress 

a. is caused by negative event 
c. is tension one feels. 




b. is caused by positive events. 

II of the above d. none of the above 



Stress symptoms: 
are physical, 
d) all of the above 



b. are psychological, 
e. none of the above 



c. are unique to each one of us. 



Part B. 

Directions : Fill in the blanks. 



4. Four steps that can help you reduce stress in a home care setting are 




(c. 



< b > ■ v 1 1 P <-(«.) 



Four common symptoms of stress in client care are 





7. Four reasons people use to put off doing things are 
(a.) 

(b.) 

8. Name one relaxation technique you can usejpj*e*TTomecare setting 
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Dealing With the Stress of the Home Care Setting 

Answer all questions based on your home care knowledge and training. 



Circle the letter of the correct answer. 
Stress 



a. is not important to most people k can be ignored, c. is only important for a short time 

d. doesn't affect most people eJis a major part of everyone's life. 

Stress 

a. is caused by negative events^. b. is caused by positive events, 
c. is tension one feels. d^all of the above d. none of the above 



Stress symptoms: 
^a. are physical, 
d/^ll of the above 



b. are psychological, 
e. none of the above 



c. are unique to each one of us. 



Fill in the blanks. 

Four steps that can help you reduce stress in a home care setting are 

ia.) hnrec^KP 



ffi) + lQQ£ 



(c.) . 






a. „• - (X \ Cl 



{ 1 *' 



Li 



Four common symptoms of stress in client care are 

(M TT £ Q±L LC\rx > r CCM rf- ( C .) cIl ■ 

(b.) Lifter -pe l . LreJ vg'S . | • 



The four categories of stressors are 
(a.) 



/ 

(«'•)_ 



(c) . 

(d) 



7. Four reasons people use to put off doing things are 

(a.) 1 (lYe\4rc, Vt t (a) 

(bL- (d.) 



8. Name one relaxation technique you can use in the home care setting: 



O 

ERIC 



"Srr-t (4 


■hhV 1 


L 


J 


r. 
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UNIT: Care Planning and Goal Setting with Your Home Care Client i 
Module 2: Controlling Time to Complete the Care Plan PRE 
Learner Assessment 

r-j . POST 

SS# Q%3 7 / 9 / 

Date: 



Location: 



Part A. 

Directions: Write a (T) if the statement is true, an (F) if it is false. 

- 1 . Spending time deciding on goals, objectives and priorities is just using time up. 

- 2. Time can be controlled by looking at objectives and setting priorities. 

. 3. People in home care don't really need to think about the way they spend their time. 

- 4. Scheduling time only needs to be done by people who are very busy and important. 
. 5. Home Health Aides can never complete all they have to do each day. 

. 6. Blocking time doesn't help most aides to see how they spend their time. 

. 7. Block time creates schedules. 

. 8. Schedules for client care tell you how long activities take. 

. 9. Schedules are based on the time people expect activities to take. 

. 1 0. The way home health aides use time affects job satisfaction. 



Part B. 

Directions: Fill in the blanks. 



11 . 



12 . 



According to the module, three common time wasters on the job are: 

(a.) 

(b.) 

(c.) i 

The steps for using a "To-Do" list are: 

(a.) 

(b.) 

(c.) 

(d.) 



(e.) 

(f) 
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Controlling Time to Complete the Care Plan 

Answer all questions based on your home care knowledge and training. 

Write a T if the statement is true, an F if it is false. 




1. Spending time deciding on goals, objectives and priorities is just using time up. 

2. Time can be controlled by looking at objectives and setting priorities. 

3. People in home care don't really need to think about the way they spend their time. 

4. Scheduling time only needs to be done by people who are very busy and important. 

5. Home Health Aides can never complete all they have to do each day. 

6. Blocking time doesn’t help most aides to see how they spend their time. 

7. Block time creates schedules. 

8. Schedules for client care tell you how long activities take. 

9. Schedules are based on the time people expect activities to take. 

10. The way home health aides use time affects job satisfaction. 




II. Fill in the blanks. 

1 1 . According to the module, three common time wasters on the job are: 
(a.) 




12 . 




The steps for using a "To-Do” list are: 

{*f 

(t>T 

(c.) 

(d.) 

(e.) 

vyC 



ERIC 
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The Seven Points of Customer Service 

PLEASE COMPLETE PRIOR TO SESSION START 

Today’s Date: 

Training Topic Title: Management Overview 

Name of Your Affiliate: 

Your Job Title: 

How Long You Have Worked for the Northeast Health System: 



DIRECTIONS: Please answer the question below BEFORE you begin this training: 



1 . What do you expect to learn or review during this training: 



(At the end of this training session, you will be given several minutes to answer the 
questions on the other side of this form.) 
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BEST COPY AVAILABLE 



The Eddy / Northeast Health / Rockefeller College 
Workforce Development Program 



New Directions in Customer Service 



ID # 

Job Title 

You and the Telephone 

Questionnnaire - -February 6, 1997 

1 . Were the scenarios realistic? y n 

2. Did you enjoy the brief video scenarios? Y n 

3. Did you recognize negative behaviors of anyone Y n 

you work with? 

4. Did you recognize some of your own negative behaviors? Y N 

5. Were the learning points clear to you? Y N 

6. Was much of the information new to you? Y N 

7. Did the module make you think about the way you talk on the 

telephone? Y N 

8. Are you more aware now than you were before about the 

difficulties of communicating on the telephone? Y N 

9. Do you think the other staff in your facility should work on their 

telephone skills? Y N 

1 0. Should this have been longer to cover more information? Y N 

1 1 .Did you learn new skills that you will use? Y N 

12. Do you think the handouts are useful? Y N 

1 3. Do you have any comments and/or suggestions? Y N 

If so, please write here: 



14. Would you be willing to promote this workshop / topic among 

others at your worksite? Y N 
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External Evaluation 
Data Collection Form 
for 

Structured Interview 



Name of Interviewee: 

Position & Name of Facility: 

Date of Interview: 

Time: 

Begin by identifying yourself and your position with the National Workplace Literacy 
Demonstration Project. Explain that you are gathering information about program 
impact through interviews such as this one. Note that the interview may last as long as 
15-20 minutes, then verify that this is a good time to meet with the interviewee. 

Read the following questions verbatim. Maintain the same inflection and tone with 
each interview conducted. Pause after each question for approximately 20 seconds. If 
no answer is forthcoming or if the interviewee expresses non-comprehension of the 
question, re-read the question. If the interviewee provides an answer that is not a 
direct response to the question, read the probe questions that accompany the main 
question. Wait for a response. Record responses on this form, abbreviating as 
necessary to capture phrasing and gist of interviewee responses. 

PLEASE NOTE: These questions are designed for gathering evaluation data from 
EDDY /Northeast Health personnel who supervise employees hired within the past year. 



1. How would you rate the performance of new hires in the use of assignment sheets? 
(Probes : On what do you base your rating(s)? Please give me some examples.) 

[understanding assignment sheet-understanding abbreviations- 
reading/writing ] 



September 2, 1997 

The EDDY/Northeast Health -Rockefeller College Workforce Development Program 
Tier I Program for New Employees, Easing into the Job 



366 



Performance Plus Learning Consultants, Inc. 
6 California Avenue, Charleston, WV 25311 
(304) 343-6861 FAX (304) 342-4996 



2 



2. How do you know whether or not new hires are managing their assignments and time 
well? 

(Probes : What happens if an employee doesn’t prioritize her/his tasks? Pleas give 
me an example of how the staff you manage works as a team. 

[managing assignment-ordering & prioritizing tasks-managing time-decision 
making-working in teams] 



3. Of the new hires you supervise, what percentage of their observations are objective, 
rather than subjective? 

(Probes : What kinds of things do new hires tend to report about the residents? 
How much of this information is factual, rather than feelings? How much of this 
information is important detail concerning changes in residents’ condition?) 

[knowing & understanding residents-objective/subjective observations- 
compare/contrast] 
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4. What types of things do you observe the new hires you supervise doing to handle 
potential job stress? 

(Probes : What are some examples of things that cause stress for new hires here? 
If you could offer one piece of advice to new hires for handling job stress, what 
would you tell them to do? 

[handling stress on the floor-predicting outcomes-cause/effect relationships] 



5. Think about the various types of information that are communicated on the floor. 
Now think of the best new hire you supervise (no names, please). What are some 
examples of the ways in which this new hire communicates? 

(Probes : What should new hires do to communicate well on the floor? What 
percentage of the new hires you supervise are “good communicators”? 

[communicating effectively on the floor-formulating questions-clarifying 
information- identifying key ideas and details] 
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Level III Evaluation Instrument 

US Dept, of Education. OVAE National Workplace Literacy Demonstration Project 
The EDDY in partnership with Rockefeller College, 1995 



VI. Asking Appropriate Questions 



5 


3 


1 


Asks to be shown or 
accompanied by supervisor on 
new tasks or if assignment is not 
understood. 




Solicits consensus from group of 
co-workers if unsure on what to 
do, then selects what he/she 
wants to do from responses. 






Listens to grapevine for 
information; continues to 
perpetuate incorrect information. 






Never refers back to policy or 
asks questions as issues arise. 










Prepared by Performance Plus Learning Consultants, Inc. 
6 California Avenue, Charleston, WV 25311-2201 
(304) 343-6861 FAX (304) 342-4996 
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WORKSHOP EVALUATION FORM 



Workforce Development Program for FY93 

The Eddy/Rockefeller College 



Title: 

Date: 

Participant Code (last 4 digits of SS#): 

Instructions. Please use this form to rate the session you have just completed. Circle the number that 
most closely matches your view. It is important for us to know whether the instruction is meeting the needs 
of the participants. Your comments will make a valuable contribution to course improvement. Thank you. 



1 . The purpose and objectives of the session were clear. 



1 


2 


3 


4 


5 


Strongly 

disagree 


Disagree 


Neither agree 
nor disagree 


Agree 


Strongly 

agree 



2. The content was appropriate to my needs and interests. 



1 


2 


3 


4 


5 


Strongly 


Disagree 


Neither agree 


Agree 


Strongly 


disagree 




nor disagree 




agree 


3. Answer 3a if you are attending Learning Strategies. Answer 3b for all other workshops. 


3a. The knowledge and skills gained from this session will help me in the rest of the 100-hour 


training. 










3b. The knowledge and skills gained from this session will help me perform my job better. 


i 


2 


3 


4 


5 


Strongly 


Disagree 


Neither agree 


Agree 


Strongly 


disagree 




nor disagree 




agree 


4. The overall quality of this session was excellent. 






1 


2 


3 


4 


5 


Strongly 


Disagree 


Neither agree 


Agree 


Strongly 


disagree 




nor disagree 




agree 



5. 1 anticipate being able to apply what 1 learned in this session to my job. 


1 


2 3 4 


5 


Strongly 

disagree 


Disagree Neither agree Agree 

nor disagree 


Strongly 

agree 


OVER 


PLEASE COMPLETE ITEMS ON BACK 


OVER 
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Activity Report: May 1995 

The Eddy/Rockefeller College Workforce Development Program 

(National Workplace Literacy Program FY 93) 
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Appendix C: 

Sample US Department of Education Data Collection Instruments 



Prepared by Performance Plus Learning Consultants, Inc. 

Rockport, WV and Charleston, WV (304) 343-6861 FAX (304) 342-4996 



EMPLOYER REPORT 



01/08/96 
Period : 2 



Employer : 



Student ' s Name 
Course Title 



Classes Classes 
Attended Offered 



Percent of Completion 
Classes Status 
Attended 



DuBrey, Gerald 

Learning Strategies-CNAs 


0 


3 


0 


-2 


Paparella, Kristina 

Learning Strategies-HHAs 


0 


3 


0 


-2 




Page 1 
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EMPLOYER REPORT 



01/08/96 
Period : 2 



Employer : 



The Eddy 



Student ' s Name 
Course Title 



Classes Classes Percent of Completion 

Attended Offered Classes Status 

Attended 



Acker, Melody 0 

Learning Strategies-CNAs 
Anderson, Terri 0 

Learning Strategies-CNAs 
Andrews, Alison 0 

Learning Strategies-CNAs 
Angerami , Cathy 0 

Learning Strategies-HHAs 
Baker, Ellen 0 

Learning Strategies-CNAs 
Ballou, Roberta 0 

Learning Strategies-HHAs 
Bariteau, Lynn 0 

^earning Strategies-HHAs 
, Pooh 3 

Learning Strategies-CNAs 
Bourassa, Pamela 0 

Learning Strategies-CNAs 
Brooks , Donna 3 

Learning Strategies-CNAs 
Carroll, Denise 0 

Learning Strategies-CNAs 
Catalfamo, Melissa 0 

Learning Strategies-CNAs 
Cavanaugh, Susan 0 

Learning Strategies-HHAs 
Cerutti, Paula 0 

Learning Strategies-CNAs 
Chamberlin, Elizabeth 0 

Learning Strategies-CNAs 
Cooke, Rosemarie 0 

Learning Strategies-HHAs 
Craft, Peggy 0 

Learning Strategies-CNAs 
Danaher, Jeanette 0 

Learning Strategies-CNAs 
Decker, Clark 0 

Learning Strategies-CNAs 
^odge, Mary 0 

^^Learning Strategies-CNAs 



3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 



Page 2 



0 

0 

0 

0 

0 

0 

0 

100 

0 

100 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 



-2 

-2 

-2 

-2 

-2 

-2 

-2 

1 

-2 

1 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 
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|['n, Deborah 0 

Learning Strategies-HHAs 
Dolen, Christie 3 

Learning Strategies-CNAs 
Dunstan, Cynthia 0 

Learning Strategies-CNAs 
Elkhatib, Ann Marie 0 

Learning Strategies-CNAs 
Farruggio, Jennifer 0 

Learning Strategies-CNAs 
Fisher, Assaltana 3 

Learning Strategies-CNAs 
Foster, Michelle 0 

Learning Strategies-CNAs 
Gilbert, Ann 0 

Learning Strategies-CNAs 
Hall, Rosalie 0 

Learning Strategies-CNAs 
Hartz, Jeannine 0 

Learning Strategies-CNAs 
Hiebel, Bonnie 0 

Learning Strategies-HHAs 
Hill, Carmella 0 

Learning Strategies-HHAs 
Jennings, Leslie 0 

Learning Strategies-CNAs 
Len, Tammie 0 

Learning Strategies-CNAs 
Kakande, Ruth 0 

Learning Strategies-HHAs 
King, Katherine 0 

Learning Strategies-CNAs 
Littlejohn, Kristin 0 

Learning Strategies-CNAs 
Marx, Andrea 0 

Learning Strategies-CNAs 
Matthews, Justin 0 

Learning Strategies-CNAs 
McNulty, Colleen 6 

Learning Strategies-CNAs 
Miner, Tracie 0 

Learning Strategies-CNAs 
Morrissey, Krista 0 

Learning Strategies-CNAs 
Normile, Michelle 0 

Learning Strategies-CNAs 
Paparella, Michelle 0 

Learning Strategies-HHAs 
Pascarella, Leonor 0 

Learning Strategies-CNAs 
Roberts, Melissa 0 

^^Learning Strategies-HHAs 



3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 



0 

100 

0 

0 

0 

100 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

200 

0 

0 

0 

0 

0 

0 



-2 

1 

-2 

-2 

-2 

1 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

-2 

1 

-2 

-2 

-2 

-2 

-2 

-2 
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• binson, Susan 

' Learning Strategies-CNAs 
Rockower, Amy 

Learning Strategies-CNAs 
Sandra, Hebert 

Learning Strategies-CNAs 
Sawyer, Melissa 

Learning Strategies-CNAs 
Schoonmaker, Jennifer 

• Learning Strategies-CNAs 
Schultz, Jennifer 

Learning Strategies-CNAs 
Searles, Barbara 

Learning Strategies-CNAs 
Silva, Myrna 

Learning Strategies-CNAs 
Slater, Lisa 

Learning Strategies-CNAs 
Stocklas, Debra 

Learning Strategies-HHAs 
Tucker, Asia 

Learning Strategies-HHAs 
VanBrocklen-Hunt , Carrie 

Learning Strategies-CNAs 
Vautrin, Jennifer 

• Learning Strategies-CNAs 
iers, Stacie 

Learning Strategies-CNAs 
Wheeler, Sarah 

Learning Strategies-CNAs 
Wheeler, Sarah 

Learning Strategies-CNAs 
Wiley, Rose 

Learning Strategies-CNAs 
Williams, Karri 

Learning Strategies-CNAs 




3 0-2 

3 0 -2 

3 100 1 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 

3 0-2 
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RECORD REPORT 



^fcnort Date: 02-29-1996 
;>rt Time: 16:57:04 
Database : Course Form 
Record # : 2 


# 


Description 


Value 


1 


Course number 


AS 02 


2 


Name of course 


What Your Assignment Shee 


3a 


Instructor's name 


Medina, Muriel 


3b 


Instructor #2 ' s name 


Katchmar, Christine 


4a 


Date course starts 


01-12-1996 


4b 


Date course ends 


01-12-1996 


5 


Number of sessions 


2 


6 


Hrs per instructional session 


2 


7 


Days per week of course 


2 


8 


Min. req. attendance in hrs. 


2 


9a 


Prerequisites for course 


01 


9b 


Pre-req course ID 


LS07 


10a 


During wkday 


.True. 


10b 


Class during lunch 


. False . 


10c 


Class after or before work 


. False . 


lOd 


Class on weekends 


. False . 


lOel 


Class held at other time 


. False . 


10e2 


When that other time is 




^feLal 


Class at worksite 


. True . 


W' i2 


Name of worksite 


Eddy-Heritage House 


x.Dl 


Class at community college 


. False . 


llb2 


Name of community college 




llcl 


Class at 4 year college 


. False . 


llc2 


Name of 4 year college 




lldl 


Class at union hall 


. False . 


lld2 


Name of union hall 




llel 


Class at school dist building 


. False . 


lle2 


Name of school district 




llfl 


Class at community organiz. 


. False . 


Ilf 2 


Name of organization 




llgl 


Class at other place 


. False . 


llg2 


Name of other place 




12a 


When learners can join 


03 


12b 


Can join until this # class 


-2 


13 


Course serves particular skill 


01 


14 


Course serves basic skill 


01 


15 


Skill lev. of lrners in course 


02 


16a 


Use of teamwork skills 


03 


16b 


Teacher-led classroom 


02 


16c 


Computer-assisted learning 


01 


16d 


Self-paced learning time 


01 


16e 


Use of audio-visual aids 


03 


16f 


Displays used from workplace 


04 
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RECORD REPORT (Con't) 



JJport Date: 02-29-1996 
;>rt Time: 16:57:04 
Database: Course Form 
Record # : 2 


# 


Description 


Value 


16gl 


Use of other instr. methods 


02 


16g2 


Other instr. methods 


Individual Skill Building 


17a 


Primary emphasis of course 


99 


17b 


Other primary emphasis 


Workplace vocabulary & 






abbreviations . 


18a 


Only reading skills taught 


. True . 


18b 


Only math skills taught 


. False . 


18c 


Reading and math skills taught 


. False . 


18d 


Writing skills taught 


. True . 


18e 


Problem solving skills taught 


. False . 


18f 


Motivational skills taught 


. True . 


18g 


Communication skills taught 


. True . 


18h 


Teamwork skills taught 


. True . 


18il 


Other skills taught 


. False . 


18i2 


Name of other skills 




19a 


Uniqueness of curriculum 


01 


19b 


Other devel of curriculum 




20al 


CASAS mth/reading test as pi . 


. False . 


^k0a2 


CASAS math/reading as pre 


. False . 


9 ' 3 


CASAS mth/rding test as post 


. False . 


^ oDl 


CASAS/ECS test as placement 


. False . 


20b2 


CASAS/ECS test as pre-test 


. False . 


20b3 


CASAS/ECS test as post-test 


. False . 


20cl 


CASAS/ listening as placement 


. False . 


2 0c2 


CASAS/Listening as pre-test 


. False . 


20c3 


CASAS/Listening as post-test 


. False . 


20dl 


TABE as placement 


. False . 


20d2 


TABE as pre-test 


. False . 


20d3 


TABE as post-test 


. False . 


20el 


ABLE as placement 


. False . 


20e2 


ABLE as pre-test 


. False . 


20e3 


ABLE as post-test 


. False . 


20f 1 


TALS/ETS as placement 


. False . 


20f 2 


TALS/ETS as pre-test 


. False . 


20f 3 


TALS/ETS as post-test 


. False . 


20gl 


BEST as placement 


. False . 


2 0g2 


BEST as pre-test 


. False . 


20g3 


BEST as post-test 


. False . 


20hl 


BINL as placement 


. False . 


20h2 


BINL as pre-test 


. False . 


20h3 


BINL as post-test 


. False . 


20il 


Supervisor ratings as pi. 


. False . 


20i2 


Supervisor ratings as pre 


. False . 
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RECORD REPORT (Con't) 



^fcport Date: 02-29-1996 
ort Time: 16:57:04 
Database : Course Form 
Record # : 2 


# 


Description 


Value 


20i3 


Supervisor ratings as post 


. False . 


20 j 1 


Group interviews as pi . 


. False . 


2 0 j 2 


Group interviews as pre 


. False . 


20 j 3 


Group interviews as post 


. False . 


2 Okl 


One-on-one interviews as pi. 


. False . 


20k2 


1-on-l interviews as pre 


. False . 


20k3 


1-on-l interviews as post 


. False . 


2011 


Learner work samples as pi . 


. False . 


2012 


Learner work samples as pre 


. False . 


2013 


Learner work samples as post 


. False . 


20ml 


Att/self -esteem inv. as pi 


. False . 


20m2 


Att/self -esteem inv. as pre 


. False . 


20m3 


Att/self -esteem inv as post 


. False . 


20nl 


Job skill comp, test as pi. 


. False . 


20n2 


Job skill comp. test as pre 


. False . 


20n3 


Job skill comp, test as post 


. False . 


20ol 


Portfolio assessment as pi. 


. False . 


2 0o2 


Portfolio assessment as pre 


. False . 


^20o3 


Portfolio assess, as post 


. False . 


A i 


Individual educ . plan as pi. 


. False . 


^^p2 


Individual educ. plan as pre 


. False . 


2 0p3 


Individual educ. plan as post 


. False . 


20ql 


Other placement 


. False . 


20q2 


Other pre-test 


. False . 


20q3 


Other post-test 


.False. 


20r 


Name of other assessment 




21a 


Other assessments of growth 


01 


21b 


List of other assessments 


Self assessment . Peer assessment . 
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OMB No.: 1875-0105 

Expires: Nov. 30, 1997 



LEARNER ASSESSMENT FORM 



The United States Department of Education is concerned with protecting the 
privacy of individuals who participate in voluntary surveys. Your responses will be 
combined with those of other survey participants, and the answers you give will 
never be identified as yours. This survey is authorized by law (20 U.S.C. 
1 22 1 e. 1 ) . You may skip questions you do not want to answer, however, we hope 
you will answer as many . as you can. It is expected that this form will require 
approximately 10 minutes to complete. If you have any comments regarding-the 
burden estimates or any other aspect of this collection of information, including 
suggestions for reducing the burden, please send them to the U.S. Department of 
Education, Information Management and Compliance Division, Washington, DC 
20202-4651; and to the Office of Management and Budget, Paperwork Reduction 
Project 1875-NEW, Washington, DC 20503. 




L-ASSESS.N WS (QUE/NWLP) 



12/21/94 3:45pm 



BEGIN HERE 



YOUR INSTRUCTOR 
WILL COMPLETE 
THESE QUESTIONS 



A. Course Number: Course Name: 



B. Who completed this form? 

(MARK ONE BOX) 

□ The learner 

□ The learner, with assistance from instructor or project staff 

□ An instructor or project staff member with information provided 
by the learner 

□ Other (Please Specify: ) 

C. Date Form Completed: 

i t ii l i i q i i t 

i i i i i I Iy i i i 

Month Day Year 



o 
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LEARNER ASSESSMENT FORM 



1. Name: 

(Last) (First) 

2. Social Security Number: 4 



3. In the future, do you plan to take any of the following courses? 

(MARK ONE ON EACH LINE) 

Plan Do Not 

to Plan to 

Take Take 



A basic skills course in reading, writing, or math □ □ 

A course in using English (such as ESL) □ □ 

A computer course □ □ 

A GED course or the GED exam □ □ 

Courses to get an occupational certificate □ □ 

A job training course □ □ 

Courses leading to a 2-year or 4-year college degree . . . . □ □ 

A home-study course □ □ 




* Giving us your Social Security number is completely voluntary and there is no penalty for not disclosing it. It is needed so that any 
information obtained later gets correctly matched with the same individual; your identity will be removed from all records once this 
q match is made. We are authorized to ask these questions by Section 406 of the General Education Provisions Act (20 USC 1221e.1). 
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1 



12 / 21/94 



4. 



Since this course began, have you: 



Learned what you wanted to learn in this course? . 

Changed your educational or career goals? 

Had more responsibility added to your job? 

Moved to a shift you prefer? 

Switched from part-time to full-time? 

Received a pay raise? 

Been promoted? 

Received an award, bonus, or other 

special recognition on your job? 

Received your GED? 

Applied for a new job? 

Started a new job at another company? 

Been laid off? 

Left your job for any other reason? (Please Specify: 



(MARK ONE ON EACH LINE) 



Yes 


No 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 



5. Please rate your ability to perform each of the following activities: 







(PLEASE MARK ONE RESPONSE 
FOR EVERY ACTIVITY) 




Poor 


Fair 


Good 


Excellent 


Read English 


□ 


' □ 


□ 


□ 


Understand English 


□ 


□ 


□ 


□ 


Speak English 


□ 


□ 


□ 


□ 


Write in English 


□ 


□ 


□ 


□ 


Work as part of a team 


□ 


□ 


□ 


□ 


Use math 


□ 


□ 


□ 


□ 


Solve problems/use reasoning . , 


□ 


□ 


□ 


□ 1 
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OMB No.: 1875-0105 

Expires: Nov. 30, 1997 



LEARNER ENROLLMENT FORM 



The United States Department of Education is concerned with protecting the 
privacy of individuals who participate in voluntary surveys. Your responses will be 
combined with those of other survey participants, and the answers you give will 
never be identified as yours. This survey is authorized by law (20 U.S.C. 
1 221 e.1 ). You may skip questions you do not want to answer, however, we hope 
you will answer as many as you can. It is expected that this form will require 
approximately 20 minutes to complete. If you have any comments regarding the 
burden estimates or any other aspect of this collection of information, including 
suggestions for reducing the burden, please send them to the U.S. Department of 
Education, Information Management and Compliance Division, Washington, DC 
20202-4651; and to the Office of Management and Budget, Paperwork Reduction 
Project 1875-NEW, Washington, DC 20503. 
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BEGIN HERE 



YOUR INSTRUCTOR 
WILL COMPLETE 
THESE QUESTIONS 



A. Course Number: Course Name: 



B. Who completed this form? 

(MARK ONE BOX) 

□ The learner 

□ The learner, with assistance from instructor or project staff 

□ An instructor or project staff member with information provided 
by the learner 

□ Other ( Please Specify: ) 

C. Date Form Completed: 



Month Day Year 




302 



LEARNER ENROLLMENT FORM 



1. Name: 

(Last) (First) 



2. Social Security Number:* 



3. Age: 

I | | years old 



4. Were you born in the United States? 

□ Yes 

□ No 



5. Sex: 




□ 


Male 


□ 


Female 



6. Are you of Spanish or Hispanic origin 
or descent? 



□ 


Yes 


□ 


No 



7. Race: 

(MARK ONE BOX) 

□ White 

□ Black (African American) 

□ Asian or Pacific Islander 

□ American Indian or Alaskan 
Native 

□ Other (P/ease Specify: 



ERIC 



Giving us your Social Security number is completely voluntary and there is no penalty for not disclosing it. It is needed so that any 
information obtained later gets correctly matched with the same individual; your identity will be removed from all records once this match 
' m ade. We are authorized to ask these questions by Section 406 of the General Education Provisions Act {20 USC 1 221 e. 1 ). 
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8 . 



Is English the language that is spoken most often in your home? 



□ Yes 

□ No 



9. How many years of school have you completed? 



(MARK ONE BOX IN BOTH COLUMNS) 



In the United States: 


In 


Anv Other Country 


□ 


No schooling 


□ 


No schooling 


□ 


1-5 years 


□ 


1-5 years 


□ 


6-8 years 


□ 


6-8 years 


□ 


9 years 


□ 


9 years 


□ 


10 years 


□ 


1 0 years 


□ 


1 1 years 


□ 


1 1 years 


□ 


1 2 or more years 


□ 


1 2 or more years 



10. Are you a union member? 

□ Yes ► What is the name of your union? 



□ No 



O 
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1 1 . Please rate your ability to perform each of the following activities. 




Read English 

Understand English 

Speak English 

Write in English 

Work as part of a team .... 

Use math 

Solve problems/use reasoning 



(PLEASE MARK ONE RESPONSE 
FOR EVERY ACTIVITY) 



Poor 


Fair 


Good 


Excellent 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 



12. Do you have a job? 



□ Yes, employed 

□ Yes, on temporary layoff 



GO TO NEXT PAGE 



□ No, retired 

□ No, not employed. 




Thank you. You have completed 
this form. Please return it to 
your instructor. 




0 
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Instructions: 

Please answer questions 13-19 for the job 
that allows you to take this course. 



13. Name of company or employer: 




(For project use only) 



14. Job title: [For example, nursing assistant, housekeeper, construction worker.] 




15. On average, how many hours per week do you work on this job? 
I I | Hours Per Week 



16. How much do you earn at this job? 



(WRITE AMOUNT AND MARK ONE BOX) 

□ Per hour 

$ 

□ Per year 

9 

ERIC 
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17. 



Do you get any of the following at this job? 



(MARK ONE FOR EACH LINE) 
Yes No 

Paid vacation □ □ 

Paid sick leave □ □ 

Paid holidays □ □ 

Health insurance □ □ 

18. How long have you worked at this job? 

I I I and |. I 



Years 



l I 

Months 



19. At your job do you need to do any of the following? 

(MARK ONE FOR EACH LINE) 



Read instructions □ 

Receive spoken instructions in English . . . . □ 

Speak English □ 

Work as part of a team □ 

Write in English □ 

Use math □ 

Solve problems/use reasoning □ 



Yes 


No 


. □ 


□ 


. □ 


□ 


. □ 


□ 


. □ 


□ 


. □ 


□ 


. □ 


□ 


. □ 


□ 



20. .Do you work at more than one job? 

□ Yes 

□ No 



Thank you. You have completed this form. 
Please return it to your instructor. 
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OMB No.: 1875-0105 

Expires: Nov. 30. 1997 







COURSE FORM 



The United States Department of Education is concerned with protecting the 
privacy of individuals who participate in voluntary surveys. Your responses will be 
combined with those of other survey participants, and the answers you give will 
never be Identified as yours. This survey is authorized by law (20 U.S.C. 
1 22 1 e. 1 >. You may skip questions you do not want to answer, however, we hope 
you will answer as many as you can. It is expected that this form will require 
approximately 5 minutes to complete. If you have any comments regarding the 
burden estimates or any other aspect of this collection of information, including 
suggestions for reducing the burden, please send them to the U.S. Department of 
Education, Information Management and Compliance Division, Washington, DC 
20202-4651; and to the Office of Management and Budget, Paperwork Reduction 
Project 1 875-NEW, Washington, DC 20503. 
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COURSE FORM 
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1 . Course Number: 



2. Course Name: 



3. Instructor(s) Name: 

( 1 ) 

(Uwt) (Firot) 



( 2 ) 

(Last) (First) 

4. Date Course Starts: 

l_l_l l_l_l 19 |_|_| 

Month Day Year 

5. Number of instructional sessions for the 
course: 

I | | Number 



6. Hours per instructional session: (If the 
sessions vary in length, please enter the 
average number of hours the course meets for 
each session.) 

I | | Hours 



7. Number of days per week that the course 
usually meets: 

! | | Number of Days 



8. What is the minimum number of hours that 
learners must attend this course in order to 
complete it? 

I | | Hours 



9. a. Is there another course that learners must 
have completed before participating in this 
course? 

oi D Yes 

OO □ No -GO TO Q.10 

b. Please give the name and the number of 
that course. 




Course Number: 

Course Name: 

1 0. When are instructional sessions usually held? 
(MARK ALL THAT APPLY) 

01 □ During the workday (but not at lunch) 

02 □ At lunch 

os □ Immediately before or after the workday 

04 □ On weekends 

o« □ Other (Please Specify: 




1 1 . Where ere instructional sessions held? (Please 
mark all that apply and provide the namefs/J 

01 □ Employer's worksite 

Name of Employer: 

02 □ Community college 

Name of College: 

03 □ Four-year college 

Name of College: 

04 □ Union hall 

Name of Union: 

06 □ Building in a local school district 

(for example, high school, activities 
building, administrative building) 

Name of School District: 

o« □ Community-based organization 

Name of Organization: 

07 □ Other [Please Specify: 

) 

1 2 . Which statement best describes whan learners 
can begin attending the course? 

(MARK ONLY ONE) 

01 □ Learners can join the course at any time 

02 □ Learners can only join the course within 

the first few instructional sessions 

(Specify the Number of 
Sessions: | | \) 



13. Does this course serve learners with a particular 
occupational or iob skill classification? 

oi □ Yes 

oo □ No 



14. Does this course serve learners with a particular 
basic skill level classification? 

oi □ Yes 

00 □ No - GO TO Q.16 



1 5. Which of the following terms best describes the 
skill level of the learners in this course? 

(MARK ONLY ONE) 

01 □ Beginning (that is, the learners have 

little or no knowledge of the course 
subject area) 

02 □ Intermediate (that is, the learners 

have some knowledge of the course 
subject area, but it is limited) 

03 □ Advanced (that is, the learners have 

a significant amount of knowledge of 
the course subject area) 



03 □ Learners cannot join the course after 
the first instructional session 
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16. Please indicate how frequently each of the following instructional methods is used in this course. 




(MARK ONE ON EACH LINE) 







Never 


Sometimes 


Frequently 


Alwavs 


a. 


Team-leaming/small group exercise or 
activity/role playing 


0* □ 


02 □ 


^ 03 □ 


04 □ 


b. 


Teacher-led classroom 


01 □ 


02 □ 


03 □ 


04 □ 


c. 


Computer-assisted learning 


01 □ 


02 □ 


03 □ 


04 □ 


d. 


Individualized/self-paced learning time 


01 □ 


02 □ 


03 □ 


04 □ 


e. 


Audio or visual instructional aids , . , . 


oi D 


02 □ 


03 □ 


04 □ 


f. 


Documents/displays taken from the workplace 


01 □ 


02 □ 


03 □ 


04 □ 


0- 


Other (Pteese Specify: . . . ... .... .... .... ... . 


on D 


02 □ 


. 03 □ 


04 □ 



> 



17. Which of the following curricular areas is the Primary or overall emphasis of this course? 
(MARK ONLY ONE) 

01 □ Literacy/pre-literacy 

02 □ Basic skills (reading only) 
os □ Basic skills (math only) 

04 □ Basic skills (reading and math) 
oe □ Writing skills 
oe □ ESL 

07 □ GED preparation/other high school preparation 

oe □ Problem solving/reasoning skills 

oe □ Motivational (self-esteem, goal setting) 

10 □ Speaking/listening/communication 

11 □ Team building 

12 □ Other ( Please Specify: 
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18. Which of the following skills are taught in this course? 
(MARK ALL THAT APPLY) 

01 □ Basic skills (reading only) 

02 □ Basic skills (math only) 

oo □ Basic skills (reading and math) 

04 □ Writing skills 

06 □ Problem solving/reasoning skills 

oo □ Motivational skills (self-esteem, goal setting) 

07 □ Speaking/listening/communication skills 
oo □ Team building skills 

o* □ Other skills ( Please Specify: 



19. Was the curriculum for this course uniquely developed for the 
(MARK ONLY ONE) 

01 □ Yes 

02 □ No, a curriculum that was uniquely developed 

for this project is used with modifications 

os □ No, a general curriculum or standard text is 
used with modifications 

04 □ No, a general curriculum or standard text is 
used with no modifications 

oe □ Other (P/ease Explain: 



402 



20. Please indicate which, rf any, of the following tests or assessment measures are used to place learners j 
this course, as a pre-test for learners in this course, or for the post-test . 










(MARK All THAT APPLY) 






Used 

for 

Placement 


Used 

for 

Pre-Test 


Used 

for 

Post-Test 


a. 


CASAS Math/Reading 


oi O 


02 □ 


03 □ 


b. 


CASAS/ECS 


01 □ 


02 □ 


03 □ 


c. 


CASAS/Ustening ... ... ......... 


01 □ 


02 □ 


03 □ 


d. 


TABE 


01 □ 


02 n 


03 □ 


e. 


ABLE ■ ■ *•■>» . ■ .... ■. ' • .... * ■ ... . .* ■ . , .. ......... 


• oi O 


02 □ 


03 □ 


f. 


TALS/STS 


01 □ 


02 □ 


03 □ 


fi- 


BEST ♦ * ♦ » » 


oi O 


02 □ 


03 □ 


ll. 


BINL 


01 □ 


02 □ 


03 □ 1 


i. 


Supervisor ratinos ...... ... ... .... . ... . . . . . . 


oi O 


02 □ 


03 □ 


j. 


Group interviews 


01 □ 


02 □ 


03 □ 


k. 


One-on-orte interviews . 


oi O 


02 □ 


03 n 


1. 


Learner work examples 


01 □ 


02 n 


03 □ 


m. 


Attitude or self-esteem inventory .... 


01 □ 


02 □ 


03 n 


n. 


Customized, job-related skill competency test 


01 □ 


02 n 


03 □ 


o 


Portfolio assessment > . . * . 


01 □ 


02 □ 


03 n 


P- 


individual learning or educational plan 


01 □ 


02 n 


03 □ 


Q. 


Other iP/aasa Spacffy : . ... .... . . 


oi O 


02 □ 


03 □ 
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21 . 



" rr.=r *° — v ° ,h *' 



01 □ Yes 

oo □ No 



* b* PI ms 6 list those instruments or approaches below. 



O 
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